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Abstract 


At the crossroads of law, conspiracy theory research and philosophy, this thesis investigates the 
permanent ban of QAnon from Facebook and Twitter, determining whether their deplatforming 
constitutes a violation of free speech. By first conducting a content analysis of free speech legislation in 
Germany and the US, it becomes evident that the matter needs to be approached from an ethical 
perspective rather than a legal one. To this end, I am testing an ethical framework suggested by Cibik 
and Hardos (2020). Based on the concept of ethical unreasonableness, the framework will be used to 
determine whether QAnon is harmful and its ban was justified. The case study consists of an in-depth 
analysis of QAnon’s evolution, distribution and core narratives in Germany and the US, followed by an 
examination of Facebook and Twitter’s justifications for deplatforming all QAnon assets. The ethical 
framework will then be applied to selected QAnon narratives based on their prevalence in the time from 
February 2020 to February 2021. It becomes clear that the ethical framework at hand needs to be 
adjusted and is unsuitable for everyday content moderation but should still be used by the social media 
companies for training purposes to improve decision making. The question of whether deplatforming 
QAnon was a violation of free speech is not easily answered as depending on the point of view it is or 
is nota violation of freedom of speech. Ultimately, big social media companies need to be redefined as 
to their role and responsibilities in today’s societies before any content moderation measures can be 
adequately examined. 
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Introduction 


Conspiracy theories are a popular cultural phenomenon and a matter of countless cultural texts 
such as movies, shows, novels and the like where they are a form of entertainment because they 
seem absurd or exciting — what if Angela Merkel z part of the Hluminati? (Martin 2019). 
However, for some people, conspiracy theories are reality, and they firmly believe in their 
truthfulness. This can have real-life consequences and implications both for believers and non- 
believers in conspiracy theories, ie. rejection of mainstream medication or decrease in political 
engagement. Conspiracy theories are a global phenomenon. Some can be found on every 
continent like the anti-vaccination movement, while other theories are confined to a certain 
geographical area only as they concern national governments. 

This thesis explores the challenges of online content moderation in light of freedom of 
speech, focusing on the particular challenges posed by conspiracy theories. To this end, I will 
be analysing the internet conspiracy theory QAnon and its ban from Facebook and Twitter, 
guided by the question of whether banning QAnon was justified or whether it is a violation of 
free speech. For this purpose, I will introduce and test an ethical framework arguing that the 
ends do not justify the means. By so doing, I am hoping to be able to offer a more nuanced 
approach to the containment of conspiracy theories on social media, making a case for stricter 
regulation of social media companies themselves while also arguing for broader freedom of 
speech on the respective social media platforms. 

Generally, a conspiracy is an “agreement between two or more persons to commit a 
crime at some point in the future” and a conspiracy theory is thus the “accusation that the crime 
of conspiracy has taken place” (Thresher-Andrews 2013, 5). Moving to the cultural 
phenomenon, historian Richard Hofstadter, who was among the first to investigate 
conspiratorial thinking, refers to conspiracy theories as the “paranoid style” “because no other 
word adequately evokes the sense of heated exaggeration, suspiciousness, and conspiratorial 
fantasy” (Hofstadter 1966, 3f.). While there are parallels to clinical paranoia, the paranoid style 
is characterised by the belief that conspiracies are directed against entire groups, nations, 
cultures and ways of life and therefore affect millions of people around the world. Paranoia, on 
the other hand, is always self-relevant and perceived as a personal attack. The paranoid style is 
generally paired with a feeling of righteousness and moral indignation (Hofstadter 1966, 3f; van 
Prooijen and Douglas 2018, 902). What is important here is that there is always a clear 
distinction between an ingroup, in this case those who believe in the existence of a particular 
conspiracy, and an outgroup, which are usually those conspiring. In the United States (US) in 


particular, conspiracy theories target the ‘Other’, be that based on religion, race, ethnicity, 


politics or sex (Fenster 2008, 11). A tendency that is very pronounced in the QAnon conspiracy 
theory, more on that in the analysis in Chapter 4. 

Contemporary definitions describe conspiracy theories as convictions that a powerful 
group of people, usually governments, secret religious groups, scientists or private industries, 
acts in secret to covertly control the political and social with the malevolent and deliberate goal 
of causing or covering up major world events (Fenster 2008, 1; van Prooijen and Douglas 2018, 
897; Thresher-Andrews 2013, 5). They are an attempt to explain one’s own position in society, 
as well as tragic events or situations for which there is either no explanation or the given 
explanation does not suffice or is rejected. In many cases, conspiracy theorists believe that the 
official explanation is a part of the larger conspiracy, even if plenty of evidence suggests 
otherwise as in the case of Pizzagate'. Most conspiracy theories are “unsubstantiated, less 
plausible alternatives to the mainstream explanation of an event” ([hresher-Andrews 2013, 5). 
Yet, they are part of our lives and there have been conspiracy theories that turned out to be true 
such as the Gulf of Tonkin incident, the Watergate scandal or the CIA mind control programme 
(Gross n.d.; Buzzworthy 2017). 

While the majority of conspiracy theories may seem absurd, they can have a harmful 
impact on individuals and society, political and scientific conspiracy theories in particular. One 
such conspiracy theory is QAnon, a politically inspired theory “rooted in a quasi-apocalyptic 
desire to destroy the existing, corrupt world and usher in a promised golden age.” (Amarasingam 
and Argentino 2020). The theory originated in the US and quickly travelled around the world. 
Once a fringe movement, it has gone mainstream and jumped from the online into the offline 
world, spreading misinformation and causing some people to commit crimes in the name of Q’. 
In light of this reality, the FBI classified QAnon as a domestic terrorist threat in 2019 and 
reinforced this warning in June 2021 (Warzel 2020; Cohen and Wild 2021). Chapter 3.1 will 
provide more information about QAnon and its evolution. 

When dealing with conspiracy theories, it is important to understand where they come 
from and who is susceptible to them in order to take targeted action. Belief in one conspiracy 
theory usually indicates belief in another and interestingly, these conspiracy theories may even 
be mutually incompatible (van Prooijen and Douglas 2018, 898). Behind this is the idea that one 


conspiracy serves as evidence for the existence of others, even if they contradict each other, 


' The Pizzagate conspiracy theory alleged that Hillary Clinton along with other top Democrats was involved in 
running a child sex ring out of the DC pizza parlour Comet Ping Pong (Aisch, Huang, and Kang 2016). 

? Most of these have been committed in the US, including the murder of Francesco Cali in March 2019 and various 
instances of vandalism and kidnapping (Beckett 2020; Dittrich et al. 2020, 17-21; Oltermann 2020). More on this 
in chapter 4. 


because they all have the same underlying idea: authorities or powerful groups are conspiring 
and covering-up what really happened. But where does this mistrust come from? Conspiracy 
theories go back in time and according to scientists, being suspicious was a vital part of surviving 
in the hunter-gatherer life. Back then, violence between different tribes was common, thus 
making assumptions about the intentions of others was necessary. There was no harm in being 
overly suspicious, but being too trusting could cost you your life (van Prooijen 2019). As we 
live in more secure times now, there is no need for this kind of hyper-suspicion. Yet, surveys 
show that the majority of Europeans and Americans believe in at least one conspiracy theory 
(COMPACT Education Group 2020, 6). It seems we are stuck with this prehistoric tendency 
to distrust others. In fact, a variety of factors, i.e. historical, economic, sociological, are at play 
that help explain our susceptibility to conspiracy theories. Furthermore, researchers have 
identified multiple psychological mechanisms that increase the likelihood of believing in 
conspiracy theories, making some more prone to them than others (Shpancer 2020; van 
Prooijen, Douglas, and De Inocencio 2018; Douglas et al. 2019). 

Apart from psychological determinants, there are a variety of other factors at play that 
influence the likelihood of believing in conspiracy theories. Yet, these factors are much more 
fluid and vary from one conspiracy theory to another. For example, people with lower levels of 
education and income seem to be more prone to believe in conspiracy theories, albeit the causal 
relationship has not yet been established (Douglas et al. 2019, 10). Furthermore, not all studies 
consistently consider parameters such as age, education or race, making it difficult to gauge 
which of these have a real impact. This paper focuses on QAnon, which is primarily a political 
conspiracy theory. It has been found that political attitudes play only a minor role in the belief 
in conspiracy theories, as people from both sides, left and right, may equally endorse conspiracy 
theories. Yet, belief tends to be more prevalent at the political extremes and slightly stronger at 
the far-right (Douglas et al. 2019, 11). Politics resemble the classic in- and outgroup mentality, 
since there is always a clear winner and loser, especially in the US where there are just two major 
political parties. Political events often trigger psychological factors that influence belief in 
conspiracy theories, i.e. political scandals reduce trust in the government and increase beliefs in 
conspiracy theories (Douglas et al. 2019, 10). Generally, those on the losing side will always 
accuse those on the winning side of conspiring. It could be shown that whenever Democrats 
were in power, they were accused of plotting by Republicans, and whenever Republicans were 
in power, they were accused of conspiring by Democrats (Douglas et al. 2019, 12). 

People have different reasons for endorsing conspiracy theories. Some do it for financial 


profit such as Alex Jones, who spreads fake news and conspiracy theories on various channels, 


including his radio show The Alex Jones Show and his websites InfoWars, NewsWars and PrisonPlanet 
(Van den Bulck and Hyzen 2020). Others use conspiracy theories for their own political gain 
like Donald Trump, endorsing theories such as the Birther movement or Spygate’ (Douglas et 
al. 2019, 6; Schlagwein 2020). Still others spread conspiracy theories because they truly believe 
in them and want to share their knowledge with others who they believe to be blinded or 
brainwashed by malevolent powers. And sometimes, conspiracy theories serve as a way of 
expressing a person’s values and challenging political discourse. This so-called expressive 
response is often triggered by anger and these people might not truly believe in a conspiracy but 
still endorse it because it helps them express something else they would like to say (Douglas et 
al. 2019, 13f; Schlagwein 2020; Richey 2017, 468). For instance, some voters in the US may not 
believe in the Birther theory, but they might still endorse it because they dislike Obama for 
different reasons. Finally, there are those who “consume” conspiracy theories and often spread 
them by telling others about all the funny conspiracies that they have heard about. Conspiracy 
theories are indeed an important part of the entertainment industry so much so that they 
constitute their own genre and there are plenty of movies and shows, te. JF'K, Al the President's 
Men or The X-Files, books, te. The Da Vinci Code or Tuminatus!, as well as games about conspiracy 
theories (Fenster 2008, 155-94). 

Conspiracy theories have been around for centuries and new advances in 
communication tools have swiftly been taken up by conspiracy theorists. Before the invention 
of the printing press, conspiracies were spread orally, often by religious leaders or members of 
the elites. Interestingly, conspiracy theories used to be endorsed by the elites, suspecting others 
to conspire against them, Le. in Ancient Rome where slaves, women and foreigners were 
regularly suspected to plot against the Roman elite. Today, it is the elites who are being accused 
of plotting against the others (van Prooijen 2019; Schlagwein 2020). With the advance of the 
printing press and an increasingly literate audience, it was possible to reach more and more 
people. In the 20" century, television and radio came along and were later joined by the 
invention of the internet. The internet significantly changed the way conspiracy theories were 
communicated, as it enabled much wider, faster and cheaper distribution of information and 
improved access to that information, pushing conspiracy theories further into the mainstream 
(Fenster 2008, 161; van Prooijen 2019). Today, conspiracy theories are spread via various media 


outlets, including newspapers, television programmes, movies, books, radio broadcasts, blogs 


3 The Birther theory alleges that former president Barack Obama is not a US-born citizen and therefore not eligible 
to be President of the US. The Spygate conspiracy theory was started by Donald Trump accusing the Obama 
administration of having planted a spy inside his 2016 presidential election campaign to help his opponent Hillary 
Clinton win (Davis and Haberman 2018; Warner and Neville-Shepard 2014, 4) 


and social media. As a result, the internet and social media in particular have become the ideal 
breeding ground for conspiracy theories and questions of content moderation have become a 
concern for big tech firms and governments alike. The recent ban of QAnon from all major 
social media platforms has caused a stir, with many fearing social media companies have too 
much power and are violating free speech. At the same time, many called on the companies to 
introduce stricter moderation measures to curb the rise of misinformation, particularly since the 
onset of the Covid-19 pandemic. 

The power and influence of big tech and social media are growing rapidly, and so are 
concerns surrounding their impact on society and individuals. Essentially an updated digital 
version of the Republic of Letters", social media allow people around the world to connect and 
interact in real time at minimum cost. They have changed the way we communicate almost 
overnight and were seen by many as a step toward a more equal world, creating a digital free 
marketplace of ideas in the spirit of John Stuart Mill that can be accessed by virtually anyone 
with an internet connection.” The lightning-speed at which technology develops and evolves 
makes it difficult for legislators to catch up and issue regulations and policies. Today, the internet 
and social media permeate our everyday lives and have profound effects on society, politics and 
the way we view the world around us. Rather than just a means for communication, social media 
have become something of a Jack of all trades: supplying us with news, entertainment, and 
communication tools. The internet has become highly commercialised and a few big tech firms 
have gained significant power allowing them to adapt and restrict access to information based 
on political and commercial interests. More drastically speaking “they are monetizing freedom 
of expression” (Stjernfelt and Lauritzen 2020, 24f). Considering that a growing number of users 
are getting their news on social media with Facebook being the biggest news source, the way 
big tech companies channel and influence the flow of information is a big deal in terms of 
freedom of speech (Newman 2020). Thus, scholars, lawmakers and policy makers stress the 
need for stricter regulation of the online world and clear responsibilities. They have identified a 
host of problems but fail to offer any viable solutions. Questions about content moderation, 


platform governance, transparency, and the use and usefulness of algorithms and AI are just the 


4 The Republic of Letters, also referred to as mpublica litterarum, Commonwealth of Learning or Community of 
Scholars, was essentially a long-distance intellectual network of scholars and learned people, who exchanged 
anything from books, letters and journals to antiquities and scientific objects. They also organized societies, 
universities, laboratories and the like in the hopes of ensnaring new ideas and objects and promoting friendships. 
The Republic goes back to the Renaissance, spanning the centuries roughly from 1400 to 1800. It was started in 
Europe but stretched across the world by the 18 century (Winterer 2012, 600). 

> It is a common misperception that the advent of social media alleviated social inequalities. If anything, they have 
exacerbated them. Yet, it is not the technology itself that contributes to these inequalities, it rather simply exposes 
them. 


tip of the iceberg. Currently, there are more questions than answers: who should be in charge 
of issuing regulations? What should such regulations look like? How may they be implemented 
and policed? Will they be valid across the globe? Can people appeal to decisions regarding their 
accounts? Which actors are involved and which roles do they play? The problem is the tunnel 
vision with which researchers and policy makers are trying to tackle these issues, when an 
increasing number of arising problems with social media clearly require a holistic approach. This 
is where my thesis comes in, situated at the crossroads of conspiracy theory research, philosophy 
and law, although the latter only provides the backdrop for the analysis. 

At present, there is a huge governance gap regarding social media, and big tech in 
general, with barely any legislation covering issues such as content moderation or deplatforming. 
Any existing legislation varies from country to country. In the US, internet service providers 
which include social media companies are even protected from any liability for third-party 
content provided on their platform according to Section 230(c) of the Communications 
Decency Act (47 U.S. Code §230). Germany on the other hand made an effort to close this 
governance gap in 2017 when the government issued the so-called Netgwerkdurchsetzungsgesetz 
(network enforcement act) in an attempt to hold social media companies accountable for the 
content on their platforms, more on that in chapter 3.3. Due to the opposing approaches to 
social media legislation and to delimit the scope of this thesis, I will focus on the US and 
Germany only. The problem is that social media companies are considered private companies; 
thus, while they need to adhere by local laws, they are free to make their own rules. The two 
companies in question, Facebook and Twitter, are based in the US but are accessible to people 
around the world. So, any decision they make affects all their users in equal measure, regardless 
of their local circumstances. Freedom of speech is a fundamental human right and Facebook 
and Twitter have voluntarily committed to respecting and protecting this along with the other 
human rights. However, freedom of speech is implemented in different ways and to varying 
degrees around the world and what may be protected in one country may not be protected in 
another. To shed light on this conundrum, I will analyse the issue of content moderation and 
more specifically deplatforming from different angles, considering legal and ethical aspects 
along with the community guidelines outlined by Facebook and Twitter. 

This thesis is divided into three parts. In part one I will give an overview of the relevant 
literature and the current state of research of the various fields. Afterwards, I will outline my 
methodology and explain the ethical framework that will be used for the analysis. In part two, I 
will provide background information on QAnon, freedom of speech and social media 


legislation, setting the stage for the subsequent analysis. To make my point and give the reader 
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an idea of the breadth of this matter, it is important to highlight relevant legislation; however, I 
will not provide a comprehensive insight into the legal aspects of the problem area. Thereafter 
I will conduct my analysis of the QAnon conspiracy theory and its ban from Facebook and 
Twitter by applying an ethical framework to determine if its ban was justified. This is followed 
by the discussion which aims at bringing together all the aspects that play a role in the 
companies’ decision-making and offering an alternative for better decision-making and ethical 
content moderation. 

This work is by no means comprehensive or exhaustive as any sensible discussion of 
free speech will have to be limited. In every society or cultural context, different values are 
competing with freedom of speech, thus imposing different limits on its exercise. Consequently, 
despite its implication, there is no free, unlimited or absolute speech. The aim instead is to 
highlight and tie together relevant debates about freedom of speech, censorship and the role of 
social media. A wide range of disciplines are concerned with these matters, yet there are very 
few inter- or transdisciplinary approaches. The aim of this work is to bridge this gap and 
contribute to the ongoing debates about the limits of free speech in the online sphere, who 
watches over this line and intervenes if necessary and which measures are appropriate. In order 
to do so, it is first necessary to identify the actors involved and their current roles which is the 


purpose of this thesis. 
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Part I: Theory 


1 Literature Review and Current State of Research 


Stjernfelt and Lauritzen’s comprehensive and transdisciplinary book Your Post Has Been Removed: 
Tech Giants and Freedom of Speech (2020) is the basis of my theoretical framework. In it the authors 
weigh in on the debate surrounding free speech on social media and who should be in charge 
of regulating giant social media platforms such as Facebook, Twitter and Google. Growing 
concerns over online disinformation and radicalisation on social media has increased calls for 
stricter content moderation and platform governance. Thus, Stjernfelt and Lauritzen analyse 
content removal practices and policies, legislation and democratic norms surrounding freedom 
of speech in the West. By so doing, they touch upon many topics closely related to the core 
issue of the role of big tech and freedom of speech in the online sphere and point out various 
problems. The book was an essential resource for my research and will be referenced 
throughout the thesis to explain the tensions between big tech, legislation and varying degrees 
of free speech and its meaning in the US and Germany. This is then complemented with works 


from conspiracy theory research and philosophy. 


Conspiracy Theory Research 

Until the turn of the century, conspiracy theory research was a rather niche subject. Richard 
Hofstadter’s essay “The Paranoid Style in American Politics”, first published in Harper’s 
Magazine in 1964, laid the groundwork for conspiracy theory research and is still considered an 
integral part of it. Interest in conspiracy theories increased considerably in the early 2000s and 
scholars from a wide range of disciplines began contributing to it. As a result, there is now an 
extensive body of work with contributions from fields such as history, philosophy, 
anthropology, media studies, political science, psychology and cultural studies. The majority of 
this work has been done in psychology, analysing and identifying psychological predispositions 
and potential triggers for belief in conspiracy theories to understand how the mind of believers 
works (van Prooijen 2019; van Prooijen and Douglas 2018; Shpancer 2020; van Prooijen, 
Douglas, and De Inocencio 2018; Douglas et al. 2019). Related to this is research on the effect 
of conspiracy belief on society and individuals’ behaviour, i.e. their political participation, 
willingness to receive medical treatments or take part in environmental actions (Imhoff, 
Dieterle, and Lamberty 2020; Jolley and Douglas 2014). There seem to be correlations between 
conspiracy theories and various parameters such as age, sex, education and socio-economic 


background or party affiliation but a causal connection has not yet been proven. Furthermore, 
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conspiracy theories are not limited to specific topics but pertain to a wide range of fields, Le. 
medicine, science, politics, religion or sports (“List of Conspiracy Theories’ 2021). Many studies 
have an underlying bias assuming conspiracy theories are categorically illogical and problematic 
and those believing in them have a damaged psyche. Recently however, there has been a push 
within conspiracy theory research to approach conspiracy theories and those who believe in 
them with more openness and neutrality (Hagen 2020; Dentith 2020). Yet, there is consensus 
that conspiracism can at times have unwarranted political and social effects and researchers are 
looking into ways to contain their spread and reduce belief in potentially harmful conspiracy 
theories. 

Nowadays, social media are often blamed for enabling conspiracy theorising and 
accelerating the spread of conspiracy theories and disinformation. In recent years, deplatforming 
has become part of the companies’ content moderation efforts, sparking debate among scholars 
over its effectiveness and usefulness with some arguing it is too heavy-handed and should only 
be used in unambiguous or extreme cases®. Cibik and Hardo§ instead suggest the use of an 
ethical framework to distinguish between harmful and harmless conspiracy theories to decide 
which ones need to be contained (Cibik and Hardos 2020). To test the suitability of their 
framework for the regulation of conspiracy theories online, I will apply their framework to 
QAnon to determine whether the actions taken by Facebook and Twitter were appropriate. 

Broad scholarly interest in the QAnon conspiracy theory was only sparked after the 
storming of the US Capitol in early 2021. Before that, it was mostly journalists who had followed 
the evolution of QAnon for many months, such as Adrienne LaFrance for the Atlantic and 
Kevin Roose for the New York Times. As a result, they have developed a deep understanding 
of the movement and its adherents. There are also some extremism researchers who started 
monitoring QAnon early on like Marc-André Argentino and Jared Holt. They collected valuable 
data much of which is not publicly available anymore due to the removal of all QAnon related 
assets and its complete ban from mainstream social media. Hence, their data and research is 
highly valuable for anyone looking to investigate QAnon. Argentino’s Twitter account is a key 
resoutce for research about online extremism generally and QAnon specifically as his feed 
resembles a timeline of minor and major events in the QAnon community which he outlines 
and contextualises shortly after they occur. His insights and data allow others to draw and build 


on his findings. Most of the researchers and journalists mentioned in this thesis are based in 


6 It is currently still contested among researchers to what extent social media enable conspiracy theorising and 
whether deplatforming is helpful or actually doing more harm than good. The latter will be addressed briefly in 
chapter 5. 
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North America where the bulk of QAnon data has been collected albeit much of it is limited to 
merely observing the movement. Due to the lack of empirical research about QAnon, I will 
draw on all research available in the North American and European context, although the focus 


of this thesis is on Germany and the US only. 


Social Media and Free speech 

Content regulation on social media inevitably brings up questions about free speech and related 
rights such as freedom of the press and freedom of thought. Freedom of speech is among the 
most heatedly debated human rights and the legal definition differs from the philosophical as 
well as the general public’s understanding. Most discussions of freedom of speech touch upon 
John Stuart Mill and his understanding of freedom of expression in “On Liberty”. While Mill 
was mostly concerned with religious, moral and political ideas that were of high importance in 
the 19" century, his work inspired many others, particularly in Europe and the US, and remains 
highly influential to this day. Mill is indispensable if one is to gain a better understanding of the 
meaning and scope of freedom of speech and is therefore a valuable source for this thesis. 

Like conspiracy theory research, freedom of speech research is also scattered across 
various disciplines from media and communication studies to law to political science to 
philosophy, all of which have different understandings of these matters. Due to the lack of clear 
definitions, they all establish their own working definitions, ultimately diminishing comparability 
across studies and fields. Due to the political and legal dimension of free speech, international 
collaboration and consideration for specific cultural, legal and political circumstances are just as 
essential as interdisciplinary cooperation. The fast-moving development of technology and the 
social media world requires any solutions to be re-evaluated regularly and adapted to new 
circumstances and realities. It is therefore important to identify the right parameters and keep 
them in check with societal changes to be able to adapt whatever solutions we might come up 
with in the future. 

This thesis zooms in on the debate surrounding conspiracy theories and free speech on 
Facebook and Twitter with examples from Germany and the US, thus providing insights into 
two specific cultural contexts and their stances on free speech and content moderation on social 
media. Conspiracy theories are a global phenomenon and closely connected to other forms of 
online disinformation. This thesis brings together findings from conspiracy theory research, law 
and philosophy to find a holistic approach to tackle disinformation while safeguarding freedom 
of speech. The framework that will be tested in the following can be applied and adapted to 


other cultural contexts and conspiracy theories. 
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2 Methodology 


The banning of QAnon and Donald Trump from social media platforms is hotly debated, 
particularly in regard to free speech but also in terms of the power social media companies 
possess. Hence, the guiding question of this thesis is, was banning QAnon a violation of 
freedom of speech or was the ban justified? Stjernfelt and Lauritzen’s book discusses the role 
of social media companies, how and where they are situated within various legal frameworks 
and how they address free speech. After reading their book, it seems to me that free speech 
legislation might not be an adequate tool to decide which content should or should not be 
banned, particularly when it comes to conspiracy theories such as QAnon. Instead, I will argue 
that an ethical framework might prove more useful to determine if questionable content should 
be banned. 

The research part of this thesis is divided into several sections: First, I will conduct a 
content analysis in order to prove or disprove the hypothesis that free speech is an inadequate 
measure for content moderation on social media. This is followed by a case study in which I 
focus on QAnon and its ban from Facebook and Twitter. Finally, I will be testing an ethical 
framework as an alternative tool to be used by social media companies to decide which content 
should be banned, particularly when faced with controversial content such as conspiracy 
theories. 

The content analysis focuses on free speech legislation, particularly legislation addressing 
social media companies and content moderation, in the US and Germany as well as its 
codification in the Universal Declaration of Human Rights of 1948. The legal texts used are the 
US Constitution, the German Basic Law and the German Criminal Code, all of which explicitly 
address freedom of speech and its limitations. Facebook and Twitter are American companies 
and as such their decisions are first and foremost informed by American legislation. The 
German Basic Law is used to contrast American free speech legislation and highlight the 
differences in how it is viewed and handled. Considering Germany has the biggest QAnon 
following in the non-English speaking world, the German perspective seems most fitting. 
Afterwards, I will investigate how Facebook and Twitter handle free speech and which content 
they do not allow on their platforms as outlined in their community guidelines. This content 
analysis is the building block for the subsequent case study in which I dive deeper into the 
reasons for QAnon’s ban according to Facebook and Twitter. 

The case study zeros in on the American conspiracy theory QAnon and its gradual ban 
from Facebook and Twitter over the course of one year, from February 2020 to February 2021. 


For this, I will analyse the statements Facebook and Twitter have issued at various points in 
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time to explain how and why they first restricted and eventually banned QAnon content. Both 
companies cite offline harm as one of the reasons the conspiracy theory has been banned. Thus, 
in a next step, I will look at incidents in which QAnon adherents committed crimes or violent 
actions induced by their belief in the conspiracy theory to confirm or refute the companies’ 
claims of offline harm. QAnon is interesting because it is a conspiracy theory that was born on 
the fringes of the internet, moved slowly into the mainstream and jumped into the real world. 
Its rise and popularity were fueled by the Covid-19 pandemic in 2020. By the time social media 
giants began taking QAnon content down, it had already travelled around the world and caused 
real world harm. Events like the Covid-19 pandemic and the 2020 US presidential elections gave 
rise to calls for action against online disinformation and social media companies decided to take 
targeted action against QAnon leading to a complete ban. This drastic measure was 
unprecedented and has triggered different reactions. Some questioned its legality regarding 
freedom of speech and others argued that freedom of speech was irrelevant and wondered why 
social media companies had not acted much earlier considering the visible impact the conspiracy 
theory had on politics in the US. Stjernfelt and Lauritzen’s deep dive into the dilemma of content 
moderation and free speech suggests that freedom of speech may not be the right parameter 
for content moderation, particularly when faced with controversial content such as conspiracy 
theories, because free speech is too broad and unspecific. The thematic breadth of movements 
like QAnon requires a more nuanced approach to decide whether a certain conspiracy theory 
should be banned or not to avoid free speech violations. 

Thus, in an effort to find a suitable alternative, I will be testing an ethical framework 
that Cibik and Hardo$ (2020) suggest using in order to determine whether certain conspiracy 
theories are harmful and therefore need to be contained. The framework, which is based on the 
concept of ethical unreasonableness, will be tested by applying it to various QAnon narratives 
to ascertain if its banning was justified. The narratives have been selected based on their 
prominence within the American and German QAnon movements which was in turn gauged 
by coverage of the specific narrative in the mainstream media such as the New York Times. 
While non-random sampling may show an underlying bias, it allowed me to pick the strands 
that are most representative of the QAnon community as they are more widespread. The data 
set is primarily compiled of secondary data like newspapers and journals, with some primary 
soutces, i.e. QAnon websites. Cibik and Hardo$ argue that a person or statement is ethically 
unreasonable if one or more of the following statements are rejected: 1. political society should 


be a fair system of social cooperation for mutual benefit, 2. citizens are free and equal, 3. 
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reasonable pluralism’ (Cibik and Hardo’ 2020, 11f). The second statement is of particular 
importance as it is most often denied by conspiracy theories which are hence considered 
unwarranted and need to be contained. The adequacy of Cibik and Hardos’s framework as well 
as its limitations will be discussed in the subsequent chapter. 

QAnon originated in the US in late 2017 and was gradually pushed into the mainstream 
which then facilitated its global spread. The research part will focus on the period from February 
2020 to February 2021, highlighting events which are believed to have led to the companies’ 
decision to ban the movement and its followers from their platforms. In this period, a lot 
happened within the QAnon community; the movement began to take traction not just in the 
US but also in Europe and was spurred on further by the Covid-19 pandemic. In the summer 
of 2020, Facebook issued a statement in which the company outlined how they will deal with 
QAnon, its adherents and any content related to the theory, explaining why they were banning 
them and how they police this ban. This statement has been updated regularly and will be the 
main source for the analysis of QAnon on Facebook. Similarly, Twitter published a brief 
statement explaining their reasons for banning QAnon in January 2021 which I will use to 
explore QAnon’s ban from Twitter. Afterwards, I will investigate whether claims of human 
rights violation of free speech are legitimate based on the incidences Facebook and Twitter 
name as having been crucial in their decision-making process. By comparing their community 
standards to their actions, it will become clear whether their actions are in line with their 
statements. Considering the vague wording of key terms such as hate speech, it is likely that 
banning QAnon is in line with their own community standards although that does not mean it 
is ethical. 

Considering the vast amount and range of existing conspiracy theories, a comparatively 
small number of them goes viral and has a lasting impact on society like QAnon. What is more, 
many theories get recycled that is they are incorporated into new narratives or adapted to new 
circumstances. QAnon is a case in point as it hosts a variety of other conspiracy theories, some 
of which have been around for many years. Therefore, this particular conspiracy theory is a 
good case for this analysis as it is a “modern” conspiracy theory in the sense that it started and 
spread online but also contains classic tropes. Extreme or life-altering events like the Covid-19 
pandemic, which facilitate conspiracy theorising, are going to happen again and other, new 


conspiracy theories will emerge that need to be dealt with. Likewise, the internet and social 


7 Reasonable pluralism is a concept described at length by John Raw! who argues that a healthy democratic society 
should not only represent a diversity of worldviews but these different worldviews should also be tolerated and 
respected (Wenar 2021). 


17 


media are not going away, so solutions need to be found as to how to either regulate these 
platforms or provide them with adequate tools to self-regulate. The analysis and subsequent 
discussion will identify key arguments and reasonings which will be applicable not just to 


QAnon but to other conspiracy theories across social media platforms. 
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Part II: Research 


3 Analysis 


3.1 A Brief Introduction to QAnon 


QAnon grew out of the Pizzagate conspiracy theory which went viral during the 2016 US 
presidential election campaign. Roughly a year later in October 2017, an anonymous user posted 
a message on the image board 4chan, predicting the imminent arrest of Clinton and subsequent 
violent revolts across the nation (LaFrance 2020; Roose 2020). From then on, the same user 
continued posting cryptic messages about future events and began using the name O ckarance 
patriot, thus simply referred to as Q. Q claims to be an intelligence officer or militant official 
with Q clearance, a Department of Energy security clearance that grants access to classified 
information (ibid.). It remains unknown whether Q is male or female or if it is one person or 
several; however, he is generally referred to as he/him. There are various speculations as to who 
is behind the pseudonym, but so far, his real identity remains unknown. It is likely that his 
identity has changed over time, especially since Q changed his home base several times from 
Achan to its successor 8chan to 8kun albeit always using the same unique tripcode® by which his 
followers can recognise him (Roose 2020). So far, he has posted nearly 5.000 messages, or Q 
drops or crumbs, with the latest one having been posted on December 8, 2020 (‘Q-Posts 
Translated in Different Languages’ 2021). The posts are scrutinised, translated and decoded by 
his followers, referred to as “anons’’.’ 

Although the theory is still fairly new, it has evolved a lot, resulting in an extremely 
convoluted theory with various sub-theories and branches, some of which have little to do with 
the original narrative or Q’s messages. This is due to two circumstances. Firstly, QAnon 
adherents have tried to attach themselves to other movements and activist causes such as the 
anti-vaccine or anti-child-trafficking movements in order to gain supporters (Roose 2020). By 
hijacking hashtags like #savethechildren, they drew people who were genuinely worried about 
the safety of children into their conspiracy theory. This also explains the eclectic mix of QAnon 
adherents that can be seen at rallies and in online forums: from young Instagram moms to new 


agers to hardcore conspiracy theorists. Secondly, none of Q’s predictions thus far have come 


8 A tripcode is a code sequence similar to a username. It allows users to post anonymously but still be recognized 
by others (Roose 2020). 

° It should be noted that the “anon’-genre is not new and neither is Q’s assert to having access to classified 
information. Long before Q’s first post there were several other 4chan users who claimed to have special 
government access, ie. FBlanon in 2016, HLIanon and CIAAnon in early 2017 (LaFrance 2020; Roose 2020; 
Argentino and Amarasingam 2020). 
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true which causes his followers to change and adapt their interpretation of the Q drops, making 
up their own stories as they go along and often swaying far from what the original messages and 
narratives are about. Since its birth, QAnon has incorporated elements of numerous other 
timelier conspiracy theories, i.e. about 9/11, Barack Obama’s birth certificate, the [luminati, 
John F. Kennedy’s assassination, the existence of U.F.O.s and many more (Stanley-Becker n.d.). 

Interestingly, not even a year after Q’s first drop, QAnon groups and websites popped 
up in Germany. Albeit still a fringe movement, it quickly soared to new heights once the Covid- 
19 pandemic swept across the continent in 2020, triggering conspiracy beliefs among large parts 
of the population (Scott 2020; Labbe et al. 2020). Today, German QAnon is the largest QAnon 
following in the non-English speaking world with at least 200.000 followers (Bennhold 2020; 
Scott 2020).'° The core narrative of the German QAnon branch also revolves around the deep 
state with Merkel as the proclaimed archenemy who is in cahoots with German elites and 
politicians in running a secret paedophilia network. QAnon adherents believe that their ultimate 
goal is to stay rich and powerful and to enslave everyone who is not part of their elite (Labbe et 
al. 2020; Beuth 2020). Because of its often anti-Semitic language and putsch fantasies, QAnon 
has attracted far-right movements like the Reichsbiirger'’ or Neonazis who were among the first 
to latch on and push the theory in Germany. Blending anti-government, anti-Semitic and anti- 
Covid-19 sentiments with beliefs about a global cabal of satanic paedophiles, the German 
movement is an eclectic mix of right-wing extremists, conspiracy theorists, anti-vaxxers and 
New Age mystics (Bennhold 2020; Kampf et al. 2020; Eisele and Benecke 2020; Zhubi and 
Ross 2020). 

QAnon is categorised as a so-called superconspiracy which 


“refers to conspiratorial constructs in which multiple conspiracies are believed to be 
linked together hierarchically. [...] At the summit of the conspiratorial hierarchy is a distant but 
all-powerful evil force manipulating lesser conspiratorial actors. These master conspitators are 
almost always [...] both invisible and operating in secrecy.” (Barkun 2013, 22). 


By absorbing other conspiracy theories and weaving them into its narrative, it managed to 
quickly grow bigger and attract more people (Eisele and Benecke 2020). Its broad range of views 


means the theory accommodates people from all walks of life. Polls show that the majority of 


10 Measuring the number of followers is tricky for various reasons. There likely is an overlap between QAnon 
groups and pages on social media as people tend to join or follow more than one group. Protests are another 
indicator for the size of a movement, but not a very reliable one either since not all followers take to the streets. 
Further, conspiracy theorists are not always outspoken about their beliefs for fear of ridicule or worse. Since social 
media companies cracked down on QAnon, it has become even more difficult to gauge the number of followers. 
1! The Reichsbiirger, or Citizens of the Reich, believe that Germany is not a sovereign country but that the German 
Reich, which ended after World War I], still exists. They do not recognize the government, its institutions or laws, 
and thus they often refuse to pay taxes, social security contributions or fines to the German state. They are 
estimated to have about 19.000 followers as at October 2020 (Bennhold 2020). 
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QAnon followers only believe in certain parts of the QAnon narrative and either deliberately 
ignore other parts or are simply oblivious to them. It is an ideological “pick-and-mix” conspiracy 
theory (Bennhold 2020; Mackay 2020). Some argue that QAnon is particularly addictive because 
it resembles so-called alternate reality games (ARGs) in which the story takes place in real time 
and seems to exist in the real world. ARGs tend to attract highly devoted people with a knack 
for solving puzzles and mysteries. Q’s ominous “Do your own research” and “You are the news 
now” speak to those people in particular and encourage them to get involved by deciphering 
Q’s messages online and looking out for clues and hidden messages in the real world, te. in 
Trump’s speeches or tweets (Warzel 2020). Furthermore, people add to the story by coming up 
with new theories and tangents. QAnon’s narratives shift constantly to include different theories 
that are tailored more towards the respective local context and are often only distantly related 
to Q. Ultimately, QAnon offers its followers a sense of importance and belonging to a 
community more than any other conspiracy theory. Believers in conspiracy theories often feel 
like they are not part of our society; they feel scared, left out and alienated. The QAnon 


community is welcoming and rewarding for those with special “research” skills (Warzel 2020). 


3.2 Freedom of Speech 


3.2.1 General and Philosophical Definition 
Freedom of speech is a fundamental human right and the pillar of modern, democratic societies. 
Just like democracy, it dates back to Ancient Greece where two concepts have shaped the idea 
of freedom of speech: zsegoria and parrhesia. The former describes the equal right to speak while 
the latter describes the right to freely voice one’s thoughts and opinions, how and when one 
pleases, and to whom (Hallberg and Virkkunen 2017, 61f; Bejan 2017). While often used 
interchangeably, both concepts are distinct, yet basic, prerequisites for freedom of speech. Over 
the past centuries, freedom of speech has by no means been a given. Many scholars, politicians 
and philosophers fought for and discussed freedom of speech before it was enshrined in 
constitutions and laws. 

One of the most widely-known discussions of freedom of speech is John Stuart Mill’s 
‘On Liberty’ from 1859 which is considered a classic and inspired philosophers, scientists and 
courts around the world. In his work, he argues that human freedom, including free speech, is 
essential for progress in science, law or politics. Mill advocated for the widest possible freedom 
of expression without governmental suppression of opinions, arguing that free and open 
discussion inevitably brings about truth, a concept later referred to as ‘marketplace of ideas’ in 


the style of Adam Smith’s free market (Cohen-Almagor 2017, 571, 578). Mill was guided by two 


21 


principles: liberty and truth, which he believed to bring happiness and good while helping to 
avoid evil. He cautioned that there is no universal truth and since it is impossible to distinguish 
between true and false with certainty, false opinions and views need to be tolerated as well. 
Likewise, true opinions need to be scrutinised and discussed frequently to have a clear 
understanding of them and to be aware of the reasons for believing them (Cohen-Almagor 
2017, 576ff; Mill 1879). Further, Mill argued that ideas should be judged based on their content 
and contribution to the debate rather than the manner in which they were uttered to account 
for different educational backgrounds allowing some to express their ideas more eloquently and 
accurately than others. He opposed any interference that would limit one’s liberty, with one 
exception: “the only purpose for which power can be rightfully exercised over any member of 
a civilized community, against his will, is to prevent harm to others” (Mill 1879). Since freedom 
of expression might affect others, it may be regulated and restricted to prevent harm. The so- 
called harm principle has since become a key tenet of political philosophy and liberalism. It is 
the only limitation Mill has put on freedom of speech; however, he did not clarify which words 
ot actions ate considered harmful. In his corn dealer analogy'’, he implied that incitement to 
violence or crime are to be suppressed, thus speech that is followed by harmful actions is to be 
punished (Cohen-Almagor 2017, 585-88). Yet, the corn dealer example is ambiguous and leaves 
room for interpretation. Mill’s understanding of free speech is very similar to that of the 
American understanding of the concept in that both believe that speech self-regulates and 
therefore needs few to no restrictions. Thus, his definition can help understand the American 
perception and scope of freedom of speech which is key to this thesis and its subject matter. 
Free speech is no stand-alone freedom but a value dependent on and in relation to other 
values such as privacy or security and thus there must be limitations to speech. Free speech and 
its limitations are defined by the social and cultural context in which they are exercised and the 
values we place on this and other freedoms or as Fish explains “Speech [...] is always produced 
within the precincts of some assumed conception of the good to which it must yield in the event 
of conflict. [...T]he freedom has never been general and has always been understood against 
the background of an originary exclusion that gives it meaning” (Fish 1994, 104). This 
understanding of free speech and its limitations may vary from century to century, decade to 


decade, or even year to year and hence needs to be re-evaluated continuously. 


12 Mill uses the example of a greedy corn dealer accused of starving the poor to explain when speech is harmful. 
According to Mill, it is acceptable to express such sentiment in print. However, it is not acceptable to make such a 
statement to an angry mob gathered outside of the corn dealer’s house. The latter constitutes an incitement and 
may lead the already angry crowd to take action that could harm the corn dealer (Cohen-Almagor 2017, 586f). 
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3.2.2 Legal Dimension and Limitations 

Throughout history, various legal texts have established freedom of speech as a constitutional 
right across the globe. Among the earliest free speech legislations is England’s Bill of Rights 
1689 which established freedom of speech within Parliament as well as some other freedoms 
like free elections and the right to petition. Its main principles apply to this day in England and 
Wales (Bil/ of Rights 1689 n.d.). English law was then brought to North America by English 
settlers and served as a model for the US Constitution and Bill of Rights which were created in 
1787 and 1789 respectively (Hallberg and Virkkunen 2017, 67). The First Amendment of the 
US Constitution grants its citizens freedom of speech along with freedom of religion, freedom 
of the press and the right to peacefully assemble and petition the government. The Constitution 
is the supreme law of the US (The Bill of Rights: A Transcription 2015). Around the same time, 
France passed the Declaration of the Rights of Man and of the Citizen in 1789, a human and 
civil rights document from the French Revolution declaring freedom of speech. It was inspired 
by the Enlightenment movement in Europe and is still current in France (Hallberg and 
Virkkunen 2017, 72). 

Freedom of speech took a little longer to be codified in Germany not least because 
Germany as we know it today did not exist yet but was a loose, fluid polity of German speaking 
peoples. Freedom of the press was first codified in the German Federal Act of 1815 only to be 
restricted again four years later in the Carlsbad Decrees. It took another century for freedom of 
speech to become a civil liberty in the Weimar Constitution of 1919 which declared in Article 
118 that every German citizen had the right to voice his or her opinion “durch Wort, Schrift, 
Druck, Bild oder sonstiger Weise” [in speech, writing, print, pictures or otherwise] (‘Die 
Verfassung des Deutschen Reichs (“Weimarer Reichsverfassung’’)’ 1919). However, Article 48 
of the Constitution, the so-called emergency decree, allowed the president of the German Reich 
to suspend civil liberties at any time. A provision which was used to full capacity by the Nazis 
who suspended Art. 118 of the Weimar Constitution in 1933. After World War I, the so-called 
Basic Law (‘Grundgesetz’) came into effect in 1949, marking the beginning of the Federal 
Republic of Germany. The first 20 Articles guarantee fundamental rights, one of which is the 
right to free speech: “Jeder hat das Recht, seine Meinung in Wort, Schrift und Bild frei zu duBbern 
und zu verbreiten und sich aus allgemein zuganglichen Quellen ungehindert zu unterrichten. 
Die Pressefreiheit und die Fretheit der Berichterstattung durch Rundfunk und Film werden 
gewahrleistet. Eine Zensur findet nicht statt.” (“Every person shall have the right freely to 
express and disseminate his opinions in speech, writing and pictures, and to inform himself 


without hindrance from generally accessible sources. Freedom of the press and freedom of 
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reporting by means of broadcasts and films shall be guaranteed. There shall be no censorship.”’) 
(Art. 5(1) GG). 

The 1689 Bill of Rights, the US Constitution and the French Declaration of the Rights 
of Man and of the Citizen are considered cornerstones of human rights and have inspired 
legislation throughout decades and around the world, not least the Universal Declaration of 
Human Rights of 1948 (UDHR). The UDHR consists of 30 articles detailing an individual’s 
fundamental human rights which are to be universally protected as “recognition of the inherent 
dignity and of the equal and inalienable rights of all members of the human family is the 
foundation of freedom, justice and peace in the world” (United Nations 1948). One of these 
freedoms is freedom of speech which is enshrined in Article 19 of the UDHR, where it states: 
“Everyone has the right to freedom of opinion and expression; this right includes the freedom 
to hold opinions without interference and to seek, receive and impart information and ideas 
through any media and regardless of frontiers.” (United Nations 1948).’The UDHR was passed 
by the newly founded United Nations after the end of World War II. The Declaration is not 
legally binding but its content influenced legal, political and social developments around the 
world. Similarly, the European Convention on Human Rights protects human rights and 
political freedoms in Europe. The Convention was drafted by the newly formed Council of 
Europe and came into effect in 1953. Article 10 of the Convention grants everyone the right to 
freedom of expression, including the “freedom to hold opinions and to receive and impart 
information and ideas without interference by public authority and regardless of frontiers” 
(Convention for the Protection of Human Rights and Fundamental Freedoms as Amended by Protocols No. 11 
and No. 14 1953). The Convention established the European Court of Human Rights (ECHR) 
whose judgements are binding for all member states of the Council of Europe. Thus, the 
Convention has had significant influence on the legislation in member states and is considered 
among the most powerful international human rights treaties. Fundamental rights found their 
way into many international treaties and the constitutions of most countries. 

Human rights are inherent and belong to everyone and states are to respect, protect and 
fulfil their citizens’ fundamental rights which they do through their judiciary. Further, they are 
interdependent which means that violation of one right might effect a violation of another (Irish 
Human Rights Commission 2012, 14-18). When it comes to free speech, courts do not protect 
speech itself but classify speech in relation to other rights and values and calculate which is of 
higher importance. This has to do with the fact that speech always serves a purpose and is not 
a ptimary value as that would mean “valuing [...] the right to make noise” (Fish 1994, 106f). 


Therefore, despite being a fundamental right, most international or regional treaties have certain 
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limitations to freedom of speech. According to the Convention, freedom of expression is 
subject to certain restrictions prescribed by national law and necessary to uphold a democratic 
society. These are primarily concerned with security, crime prevention and the protection of 
health and morals (Convention for the Protection of Human Rights and Fundamental Freedoms as Amended 
by Protocols No. 11 and No. 14 1953). In Germany, Art. 5 of the Basic Law states that there is no 
censorship to free speech and that freedom of speech may only be limited by law. These 
limitations can be found in the Criminal Code (StGB). Germany is known for having very strict 
laws on hate speech and the promotion or glorification of Nazism as well as Holocaust denial. 
The latter can be punished with up to five years in prison or a fine. According to the Criminal 
Code, hate speech includes insulting segments of the population or a national, racial or religious 
group, ot one characterised by its ethnic customs (§130 StGB). Further, there are penalties for 
defamation of the President, insulting the Federal Republic, its states, the flag or the national 
anthem. While the latter penalties are part of the Criminal Code, they are almost never invoked 
as even the harshest political criticism does not constitute insulting the Federal Republic 
(Hallberg, Virkkunen 2017:89) The US on the other hand “accords the widest legal latitude to 
speech of any Western democracy” similar to Mill’s ‘marketplace of ideas’ (Leiter 2016, 409). 
Nonetheless, exceptions exist albeit not in the constitution but in common law, thus some 
speech may be restricted by the government and made illegal. Unprotected speech includes 
obscenity, defamation, child pornography, incitement to violence or any lawless action, threats, 
fighting words or fraud. Unlike in Germany, hate speech is not a crime in the US. Racist, sexist, 
homophobic speech, or speech hostile to any religion is thus not punishable unless it is uttered 
alongside other fighting words or used as a threat (Volokh 2020; Hallberg and Virkkunen 2017, 
110; ‘What Does Free Speech Mean?’ n.d.). The problem with hate speech is that there is no 
clear definition of the term, thus it can easily be misused to silence legitimate or true statements 
about different groups in society (Stjernfelt and Lauritzen 2020, 14-16). At the same time, the 
definition of what is considered insulting, degrading or provocative speech changes from person 
to person and from circumstance to circumstance, “every idea is an incitement to somebody” 
(Fish 1994, 106). The crux of free speech is that it applies to everyone equally which can be 
difficult to accept as Stjernfelt and Lauritzen explain: “[T]olerating views one agrees with is the 
easy part. But the fact that also Nazis, Islamic extremists or Communists should have the right 
to express their views on reality and the future is something that many people need a certain 
degree of self-reflection to accept” (Stjernfelt and Lauritzen 2020, 15). 

Freedom of speech is an integral part of both the US Constitution and Germany’s Basic 


Law, yet it holds different levels of significance in both countries due to different histories. The 
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US Constitution is much older and has shaped American identity profoundly. Freedom of 
speech is an integral part of its identity. The German identity revolves less around the German 
constitution but is rooted in European history and values. The terror of nationalism and 
subsequent reckoning with the past shaped Germany’s Basic Law and the country’s collective 
identity including its stance on free speech. As a result, there are slightly more restrictions on 
speech, that is on speech which is considered hateful and an incitement of the people, including 
holocaust denial. Generally, hate speech is very context-sensitive and its definition is kept 


relatively vague to avoid misuse, i.e. to silence political standpoints. 


3.2.3 Social Media: Facebook and Twitter’s Stance on Free Speech 

Social media do not define freedom of speech nor are they legally obliged to protect it as this 
falls within governmental responsibility (Jorgensen and Zuleta 2020, 54). Rather, in their 
community standards, Facebook and Twitter outline actions and speech that are not tolerated 
on their platforms as well as sanctions and steps taken by the companies to deal with these 
offences. Both companies regularly publish transparency reports in which they explain how they 
enforce their policies, disclose the number of data and information requests and how they 
protect their users (Facebook Transparency 2021a; Twitter Inc. 2021d). 

Facebook’s community standards cover six topics: violence and criminal behaviour, 
safety, objectionable content, integrity and authenticity, respecting intellectual property, and 
content-related requests and decisions. These policies “are based on feedback from [theit] 
community and the advice of experts in fields such as technology, public safety and human 
rights” and are “grounded in three core principles: giving people a voice, keeping people safe, 
and treating people equitably” (Facebook 2021; Allan 2018). Facebook has repeatedly expressed 
its commitment to human rights and freedom of speech in particular, allowing the “maximum 
possible range” of free expression (Facebook, n.d.; Kang and Isaac 2019; Allan 2018). 

Similarly, Twitter also has an extensive set of policies and rules which “are to ensure all 
people can participate in the public conversation freely and safely” (Twitter Inc. 2021c). The 
company names freedom of speech as one of their core principles which is not just grounded 
in the US Constitution and the European Convention on Human Rights but also informed by 


their Trust and Safety Council’ as well as various other global activists and advisors (Twitter 


13 This council consists of independent expert organisations from around the world who advocate for safety on 
Twitter. It is divided into expert groups which each focus on specific issues deemed critical to the health of public 
conversation. Focus areas are Online Safety and Harassment, Human and Digital Rights, Suicide Prevention and 
Mental Health, Child Sexual Exploitation, and Dehumanization (Twitter Inc. 2021a) 
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Inc. 2021e). In their Hateful conduct policy, the company lists behaviour that is not tolerated 
on Twitter, including certain words or actions. 

Paradoxically, Facebook’s community standards regarding hate speech are incredibly 
restrictive and at the same time kept (deliberately) vague, often adding “but not limited to” or 
“for any reason,” allowing the company to censor speech more easily. Even if users had the 
possibility to appeal to a decision, they most likely would not get a straight-forward answer as 
to why exactly their post was removed. Twitter’s community standards go a step further by 
providing information on what the consequences of hateful conduct are. Overall, their 
community standards are a lot stricter than legislation regarding hate speech due to the 
companies’ own economic interests. To be able to monetise their services, they must ensure 
their users feel safe, comfortable and engaged, thus the platforms are keen to maintain an 
agreeable environment which includes regulating extreme speech (Stjernfelt and Lauritzen 2020, 
90; Johnson 2018, 1275). Interestingly, the rules outlined in the community standards often do 
not apply to public figures as was the case for Facebook and Twitter both of which made 
significant exceptions for public figures until recently. Twitter explains that they “limit 
exceptions to one critical type of public-interest content —’ Tweets from elected and government 
officials — given the significant public interest in knowing and being able to discuss their actions 
and statements” (I'witter Inc. 2021b). Thus, exceptions will only be made if a Tweet violates 
one or more rules outlined in the community standards, was posted by a verified person who is 
a “current or potential member of a local, state, national or supra-national governmental or 
legislative body”, and who has more than 100.000 followers on Twitter. Further, should the 
company decide to make an exception, they label the Tweet accordingly informing users that it 
violates the community standards which in turn limits its spread (Twitter Inc. 2021b). These 
rules were put in place in June 2019 and have only been slightly updated since (Twitter Safety 
2019). Facebook’s definition is broader than Twitter’s defining public figures as “state and 
national level government officials, political candidates for those offices, people with over one 
million fans or followers on social media and people who receive substantial news coverage” 
(Facebook Transparency 2021d). Facebook refers to this as the newsworthiness allowance 
which can include content from “news outlets, politicians, or other people” (Facebook 
Transparency 2021b). This policy was published in June 2021 albeit sections of it seem to have 
been part of internal content moderation policies. Before that the company deliberately shielded 
certain politicians from content moderation measures such as fact-checking, essentially handing 


them a free ticket to post anything they wanted without any repercussions (Heath 2021). 
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3.3 Social Media Legislation in the US and Germany 
When it comes to social media legislation, the current state of legislation regarding online 
misconduct is accurately summarised by Alex Mills who concludes that “[...] defamation online 
is a twenty-first-century problem which remains regulated by a nineteenth-century rule.” (Mills 
2015, 34). In fact, social media platforms are usually regulated by non-state private entities that 
are self-regulated rather than being regulated by national institutions and national law and thus 
operate within the remit of private law. Generally, companies are obliged to abide by local laws, 
meaning every country in which they have an office (Gorwa 2019, 861f). Facebook and Twitter 
do not have offices in all the countries in which they operate and therefore, are not bound by 
their local laws. While many countries do not even have any legislation that regulates social 
media and big tech firms, Germany and the US do. The American Communications Decency 
Act of 1996 is one of the first attempts to regulate the online sphere. However, in reality, it 
protects online service providers from being held responsible for the content posted on their 
website by third-parties, i.e. social media users. Thus, Facebook and Twitter are exempt from 
any liability regarding the content of their platforms whatsoever since neither Facebook nor 
Twitter produce the content themselves. Germany on the other hand, recently issued a much 
harsher legislation, the so-called Netgwerksdurchsetzungsgesetz (Network Enforcement Act, 
henceforth NetzDG) which came into effect in 2017. The law, often referred to as Facebook 
Act, applies to all for-profit social media platforms with more than 2 million registered users in 
Germany and makes it mandatory for these platforms to remove flagged or reported content. 
Obviously illegal content must be blocked or deleted within 24 hours, while other complaints 
must be handled within seven days. Failure to do so can result in high fines for the respective 
social media company. Further, social media companies must issue a report every six months 
on how they have handled complaints. The NetzDG has been harshly criticised from all sides 
with some saying it is too weak and the list of criminal offences is incomplete. Others argue that 
the law incentivises over-removal by threatening to impose sanctions. However, the companies’ 
transparency reports as well as the government’s evaluation after three years have shown that 
the latter fears are by and large baseless (“Bericht der Bundesregierung zur Evaluierung des 
Gesetzes zur Verbesserung der Rechtsdurchsetzung in  sozialen Netzwerken 
(Netzwerkdurchsetzungsgesetz - NetzDG)’ 2020, 21f.; Echikson and Knodt 2018, 15). 
Overall, legislation of the online domain is lagging behind and the main reason for that 
is the lack of definitions. First of all, there is no clear definition of what social media companies 
do and what their role and responsibilities are. On the one hand, social media platforms 


constitute a public space, on the other hand, they are private companies. Thus, legally speaking, 
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Facebook and Twitter, because they are privately governed and provide commercial services, 
are free to define what is and is not allowed on their platforms and have no legal obligation to 
protect freedom of expression. Yet, states and governments are obliged to ensure the protection 
of human rights in the realm of non-state actors, i.e. social media platforms. Hence, they have 
issued recommendations and guidelines like the Guiding Principles on Business and Human 
Rights adopted by the UN Human Rights Council in 2011. These as well as most other 
recommendations are nonbinding and rely on tech companies to adhere to them voluntarily 
(Jorgensen and Zuleta 2020, 52, 56f). Further, the definition of hate speech which is generally 
banned on social media platforms is incredibly vague both in their terms of services as well as 
legal definitions of hate speech around the world (Jorgensen and Zuleta 2020, 58). Law is based 
on definitions and can only be applied effectively when there are set boundaries and regulations. 
While Stjernfelt and Lauritzen acknowledge the problem of vague or ill-defined terms, they 
rightfully point out that hate speech legislation could easily be misused “to silence legitimate 
political standpoints and even true statements about problems concerning different groups in 
society” and are thus wary of such legislation (Stjernfelt and Lauritzen 2020, 15f). So far, much 
has been decided on a case-by-case basis and oftentimes courts even shirked to deliver a 
judgement entirely (Barnbard 2020, 1027f.). Clear-cut definitions of the boundaries of free 
speech online and the roles of social media companies will make it easier to formulate laws and 


policies, more on that in Chapter 5. 


4 Case Study: Testing an Ethical Framework for Content 


Moderation 


What is QAnon’s narrative? 

At its core, the QAnon narrative revolves around the battle of Good versus Evil. Adherents 
believe in the existence of a global cabal or deep state consisting of members of the elite from 
around the world. This elite of Satan-worshiping paedophiles includes top Democrats such as 
Barack Obama and Hillary Clinton, various entertainers and Hollywood celebrities like Oprah 
Winfrey and Ellen DeGeneres, as well as religious leaders like the Dalai Lama and Pope Francis. 
George Soros, the Rothschild family and the House of Saud form a triumvirate at the heart of 
this alleged cabal (Lawrence and Davis 2020, 9; Roose 2020). They are secretly torturing, killing 
and eating children in order to extract a life-extending chemical, adrenochrome, from their 
blood (Evans 2020). Donald Trump was recruited by the military to become president so that 


he can break up this global cabal and punish the elites, an event also referred to as “the Storm”. 
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However, this storm can only be accomplished with the help of loyal patriots who search for 
meaning in the Q drops (LaFrance 2020). However, the core narrative is just the beginning. The 
German QAnon website Qlobal-Change currently lists nearly 100 entries that cover individuals, 
countries and topics considered to be somehow patt of, involved in or fighting against the evil 
cabal or some other conspiracy theory'* (Qlobal-Change n.d.). 

That a global pandemic sparks conspiratorial thinking is to be expected and not a new 
ot surprising development. QAnon’s way of absorbing other conspiracy theories meant it took 
very little time for it to merge with Covid-19 conspiracy theories and, as Lawrence and Davis 
analysed, this is partly due to Q’s efforts “who has repeatedly suggested that measures to control 
the pandemic are part of a plot to subvert the US election” (Lawrence and Davis 2020, 9). 
Covid-19 conspiracy theories are as plenty as they are contradicting. It is speculated that the 
virus is either a false flag operation or a hoax as often promoted by former president Trump in 
the beginning of the pandemic (#plandemic #scamdemic), or that it is a bioweapon created by 
the deep state to manipulate the US elections or a bioweapon created by China to wage war 
against the US (Lawrence and Davis 2020, 9; Douglas 2021, 270). At some point, some QAnon 
followers suggested that the virus was part of Trump’s and Q’s plan and that everything was 
under their control (Marc-André Argentino 2020a). Then there are theories that 5G towers 
spread Covid-19 which led many to vandalise the masts or attack technicians working on them 
(Douglas 2021, 272; Lawrence and Davis 2020, 9). For a while it was purported that Asian males 
were significantly more susceptible to the virus based on an obscure study that was not peer- 
reviewed ot published at the time’? (Zhao et al. 2020; Marc-André Argentino 2020b). Depending 
on the event that occurred during the pandemic, the conspiracy theories supported by QAnon 
adherents changed and the narrative shifted. Bill Gates and Anthony Fauci, director of the US 
National Institute for Allergies and Infectious Diseases during Trump’s presidency, have both 
been targets for promoting measures such as wearing face masks and getting vaccinated. 
Theories allege that Bill Gates wants to vaccinate everyone because there are microchips in the 
vaccine that would let him control everyone. Further, Fauci, Gates and Soros are believed to 
have enormous financial interests in the pandemic. Another theory popular among QAnon 
adherents is that Covid-19 serves as a cover-up for child sex trafficking (Spring and Wendling 
2020). The latter is a central theme of the QAnon narrative that can be found in many other 


theories, such as the Wayfair conspiracy theory which popped up in June 2020 alleging the 


14 Despite the note at the top of the page, it seems that the list has not been updated in a while. Nonetheless, it 
serves as an indication for the number of theories that are part of QAnon. 

15 The article was peer-reviewed and published in the American Journal of Respiratory and Critical Care Medicine 
later that year but does not confirm any such claims (Zhao et al. 2020). 
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online furnishing company was trafficking children. Although the theory was started by people 
who are likely not part of QAnon, the QAnon community was quick to pick it up with known 
QAnon influencers quickly spreading across several platforms (Marc-André Argentino 2020c). 

This portrays how convoluted, contradicting and interconnected all these individual 
conspiracy theories are. According to QAnon, the pandemic was used to interfere with the US 
presidential election and to prevent Trump’s re-election, thus thwarting his plans to break up 
the cabal. Not surprisingly, election fraud was another popular topic among QAnon 
proponents, one that had constantly been fuelled by Trump and far-right media, even long after 
the elections and it eventually led to the insurrection at the US capitol. 

Lawrence and Davis describe QAnon as “a decentralised, grand and multifaceted 
phenomenon, at once a conspiracy theory, a political movement and a quasi-religion, with 
variants tailored to chime with different subcultures and national contexts. Its central narrative 
blends legitimate concerns about child trafficking and child abuse with fantastical 
misinformation and anti-Semitic tropes [...]” (Lawrence and Davis 2020, 8). In other words, it 
is an extremely volatile umbrella conspiracy theory that quickly absorbs other theories and 
weaves them into its narrative. Neither Facebook nor Twitter named specific narratives or 
tropes of the QAnon ideology that they oppose. Rather, they say they do not tolerate hate 
speech, any form of violent speech or speech that leads to offline harm. Considering that no 
QAnon content that has been posted on either one of the platforms is accessible anymore, the 
analysis will focus on QAnon’s narratives as listed on various QAnon websites. As it would go 
beyond the scope of this paper to analyse all of its narratives, the analysis is limited to the most 
prevalent parts of the conspiracy theory: its core tenet about a paedophilic cabal and deep state 
that is battled by Trump, various theories surrounding Covid-19 and election fraud during the 
2020 US presidential election. The core tenet is the building block of QAnon which is rooted 
in pre-existing conspiracy theories. The presidential election is a rather US-centric topic while 
Covid-19 affected people around the world. Together, the selected theories reflect the versatility 
and volatility of QAnon in the period from January 2020 to April 2021. 


Why was QAnon banned from Facebook and Twitter? 

On August 19, 2020, Facebook issued a report explaining how the company addresses 
movements and organisations that are tied to violence, specifically any “Facebook Pages, 
Groups and Instagram accounts tied to offline anarchist groups that support violent acts amidst 
protests, US-based militia organizations and QAnon” (Facebook Inc. 2020). While incitement 


to violence is generally not tolerated on Facebook, the company argued that their Dangerous 
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Individuals and Organizations policy needed to be expanded considering the growing number 
of movements with individuals either celebrating violent acts or showing violent behaviour and 
therefore pose “significant risks to public safety” (Facebook Inc. 2020). This policy expansion 
included restrictions that limit the spread of content, as well as removal of pages, groups and 
accounts discussing potential violence. Further actions included limitation of recommendations, 
lower ranking in the News Feed, search restrictions, removal of the related hashtags feature, 
prohibition from running ads or using the Marketplace or Shop, as well as prohibition of any 
form of fundraising in support of abovementioned groups. This resulted in the removal of 790 
groups, 100 pages and 1500 ads linked to QAnon, the blocking of over 300 hashtags across 
Facebook and Instagram and restrictions on nearly 2000 groups and 440 pages on Facebook 
(Facebook Inc. 2020). 

The report has since been updated five times at irregular intervals with the first update 
being published roughly a month later on September 30, 2020 (Facebook Inc. 2020). In this 
update, Facebook took a stronger stance against QAnon, explicitly mentioning that any actions 
taken are to limit QAnon’s spread and visibility on Facebook. As part of this, Facebook began 
redirecting people to credible resources when certain hashtags are searched for. This was in light 
of growing evidence that QAnon adherents hijacked other movements’ hashtags for instance 
concerning child safety to recruit and organise (Facebook Inc. 2020). The second update on 
October 6, 2020, highlighted the growing number of groups and pages that had been removed 
because of their ties to QAnon or other militarised social movements. Facebook vowed to still 
increase their efforts against QAnon, explaining that from then on, any Facebook pages or 
groups representing QAnon would be removed, even if they did not contain violent content. 
They justify this by saying that “while we’ve removed QAnon content that celebrates and 
supports violence, we’ve seen other QAnon content tied to different forms of real world harm, 
including recent claims that the west coast wildfires were started by certain groups, which 
diverted attention of local officials from fighting the fires and protecting the public” (Facebook 
Inc. 2020). The third update was published on October 21, 2020, titled “An Update on Our 
Enforcement Against QAnon”, illustrating how the conspiracy theory became the centre of 
attention in Facebook’s efforts to tackle violent behaviour and extremism. In this third, rather 
short, update, Facebook stated that users searching for QAnon will be redirected to credible 
soutces from the Global Network on Extremism and Technology (GNET), an academic 
reseatch initiative that aims to counter terrorism, which Facebook began partnering with. The 
fourth update followed a week later on October 27, 2020, updating the number of pages, groups 


and accounts that have either been removed or restricted because of their connection to QAnon 
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(Facebook Inc. 2020). The fifth and most recent update followed almost three months later on 
January 19, 2021, again updating the numbers of removed accounts, pages, groups and even 
events. Apart from new numbers, the last two updates are nearly identical in wording. 
Interestingly, the fifth update does not refer to the storming of the US Capitol that had occurred 
only two weeks earlier (Facebook Inc. 2020). 

Like Facebook, Twitter also bans hateful conduct which includes any promotion of 
violence against, direct attack of or threat to other people on the basis of race, ethnicity, national 
otigin, caste, sexual orientation, gender, gender identity, religious affiliation, age, disability, or 
serious disease (['witter Inc. 2021f). Targeted harassment or the expression of hate towards a 
person, group or protected category with words or images is prohibited. The company 
recognises that “our role is to serve the public conversation, which requires representation of a 
diverse range of perspectives” and argues that online abuse “can jeopardize (an individual’s) 
ability to express themselves.” (ibid.). The company’s official Twitter account @TwitterSafety 
announced in a tweet on June 22, 2020, that from that day on, the company would take action 


against QAnon over safety concerns, see image 1 (Iwitter Safety 2020). 


Twitter Safety @ @TwitterSafety - Jul 22, 2020 


We've been clear that we will take strong enforcement action on behavior 
that has the potential to lead to offline harm. In line with this approach, 
this week we are taking further action on so-called ‘QAnon’ activity across 
the service. 


© 19.1K Tl 29.8K © 85.4K it, 


Figure 1: Twitter announces actions against OAnon assets across the platform (Twitter Safety 2020) 


These actions included the permanent suspension of any assets associated with QAnon in trends 
and recommendations, no further promotion of the movement in searches and conversations 
as well as blocking of URLs associated with QAnon from being shared on Twitter. The new 
measures were taken as part of the company’s effort to police content that may lead to offline 
harm and QAnon had been identified as a potential threat. In the following weeks, several 
thousand accounts tied to QAnon had been suspended from the service. In a response to the 
storming of the Capitol in DC, Twitter issued a statement on January 12, 2021, updating their 
coordinated harmful activity policy (Twitter Safety 2021). Twitter directly addressed the 
storming of the Capitol and linked its policy updates to the events on January 6, 2021. In this 
context, thousands of accounts associated with QAnon were permanently suspended (BBC 


News 2021; Twitter Safety 2021). 
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Both companies justify their banning of QAnon related assets by arguing the conspiracy 
theory has violated their policies regarding hateful conduct. According to them, QAnon is a 
“violence-inducing conspiracy network” (Facebook Inc. 2020) that has the potential to cause 
real-world harm. In fact, there have been violent incidences in both the US and Germany that 
were connected to QAnon. The first noteworthy incident within the period investigated in this 
thesis occurred in December 2019, when a mother was arrested for trying to kidnap her 
daughter who was living with a foster family. She was assisted by other QAnon adherents who 
helped her execute the plan (Dittrich et al. 2020, 18; Beckett 2020). This is exemplary of the 
majority of QAnon related incident in the US in which adherents either try to “save” either their 
own children, i.e. from child protective services, or other people’s children which they believe 
to have been kidnapped by paedophiles. Similar events occurred in March 2020, June 2020, 
August 2020 and October 2020 (Beckett 2020; Dittrich et al. 2020, 18-21). 

There were other incidences as well that did not involve children. In March 2020, 
Eduardo Moreno derailed a train close to the USNS Mercy, a naval ship that was stationed in 
San Pedro to treat Covid-19 patients. While it is unclear whether Moreno was inspired by 
QAnon specifically, especially since the USNS Mercy was never mentioned by Q, interviews 
with Moreno show that he believes in conspiracy theories generally. Some of his remarks 
following his arrest seem related to QAnon, such as the claims that “the whole world is 
watching” and that he wanted to “wake people up” by derailing the train are reminiscent of 
words used by Q (Amarasingam and Argentino 2020, 39; Beckett 2020). Further, in April 2020, 
Jessica Prim who livestreamed her trip from Illinois to New York City on Facebook, threatening 
to kill Joe Biden and Hillary Clinton for their supposed involvement in a deep state sex 
trafficking ring, a core tenet of the QAnon narrative. After her arrest, police found multiple 
knives in her car. While nobody got hurt, Prim’s case portrays the speed at which some QAnon 
followers get radicalised. Her social media posts show that she first came across QAnon 
propaganda in early April of 2020 and began making threats of offline violence mere 20 days 
later on her trip to New York City (Amarasingam and Argentino 2020, 39f). In early January 
2021, the US Capitol was stormed by a mob of Trump supporters who believed the election 
“was stolen” from him. The rioters included not just QAnons but members of other groups as 
well, like far-right militants, white supremacists and neo-fascist Proud Boys (Biesecker et al. 
2021). Nonetheless, QAnon made up a large part of the rioters with some prominent figures 


16 


among them such as the so-called Q Shaman’. Unlike previous instances, this one was 


‘6 The nickname of Jake Angeli, a notorious QAnon follower who stands out because of his unique outfit: a horned 
fur hat and face paint (McCarthy 2021). 
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incredibly violent: five people died, one police man and four rioters, and many more were 
injured. The insurrection triggered many social media platforms to ban Trump as well as QAnon 
and other groups from their services for incitement of violence (Biesecker et al. 2021; Twitter 
Inc. 2021g; Rosen and Bickert 2021). 

In Germany, there have also been some instances in which adherents committed crimes 
in the name of QAnon. The first noteworthy incident were the Hanau shootings in February 
2020, when a far-right extremist killed eleven people and injured five before killing his mother 
and himself. The massacre was classified as terrorism by the authorities. Investigations later 
revealed that the perpetrator’s world view was shaped by an eclectic mix of racist, anti-Semitic, 
Islamophobic and conspiratorial beliefs. Although according to investigations he was not a 
QAnon adherent, the manifest which he had published online prior to his attack contained 
distinct references to QAnon (Zhubi and Ross 2020; Dittrich et al. 2020, 17). 

The German QAnon movement is intricately connected to various other, mostly far- 
tight movements like Querdenken 711" or the Reichsbiirger. This makes it harder to clearly 
distinguish between QAnon adherents and followers of other movements as oftentimes, they 
are part of both due to an ideological overlap between them. When the Covid-19 pandemic 
arrived in Germany in March 2020, the German government took action by introducing various 
measures in hopes of curbing the outbreak. These included the closing of schools, travel 
restrictions to Germany, social distancing, nightly curfews and eventually a full lockdown. 
Shortly after, people began protesting these measures with more people taking to the streets 
and protests getting more violent each time. At these protests, an eclectic mix of far-right 
activists, new-agers and conspiracy theorists walked side by side. QAnon was present from the 
beginning with a rising number of Q signs appearing at protests over the course of the year. 
Events took a dramatic turn in August 2020 when protesters, among them several QAnon 
followers, stormed the steps of the German Bundestag, in an attempt to capture the building — 
foreshadowing the incident on January 6, 2021, when protesters successfully stormed the US 
Capitol. 

Another incident occurred in October 2020 when around 70 artworks and ancient 
artefacts were visibly damaged at the Pergamon Museum, Alte Nationalgalerie and Neues 


Museum in Berlin. While the perpetrators and motive have not been confirmed, many have 


'T Querdenken 711 is a self-proclaimed “initiative” that was founded in Stuttgart in 2020 to protest Covid-19 
restrictions in Germany, particularly social distancing and the national lockdown. 711 is simply the dialling code 
for Stuttgart. The movement quickly spread to all parts of Germany and could be seen at regular protests 
throughout the country. Even though the initiative claims to be non-partisan, it is widely associated with far-right 
patties, extremist movements and conspiracy theorists (Khamis and Rohrmeier 2020). 
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linked the attack to QAnon. The Pergamon Museum in particular had become a target for 
conspiracy theorists who claim it is the centre of the global Satanism scene as it holds a 
reconstruction of the ancient Greek Pergamon Altar. Attila Hildmann, a former vegan celebrity 
chef who has become one of the most fervent QAnon proponents posted messages on his 
Telegram channel in the months prior to the attack alleging that Angela Merkel used the altar 
for human sacrifices and calling on his followers to storm the museum (Oltermann 2020; Morris 
and Beck 2020). Dittrich and colleagues outline a case of a man who damaged a cell tower and 
called on his followers to do the same in order to end the Covid-19 pandemic, as some believe 
that 5G towers are spreading of the virus. According to the authors, his case is representative 
of many others and showcases how quickly and easily people can get radicalised through 
conspiracy theories, in particular the QAnon conspiracy theory, causing them to lose touch with 


reality and commit crimes such as aforementioned vandalism (Dittrich et al. 2020, 24ff.). 


Testing an ethical framework: Are these narratives ethically unreasonable? 
The difficulty is determining whether a conspiracy theory is harmful or not. Cibik and Hardos 
argue that “defining conspiracy theories by their flaws in reasoning, questionable coherence or 
factual mistakes can neither sharply distinguish problematic theories from other, non- 
problematic worldviews nor justify state action” (Cibik and Hardos 2020, 1). They therefore 
propose a different approach and suggest understanding conspiracy theories through ethical 
criteria instead to guide public policy and state action. The following section will analyse the 
selected QAnon narratives using the approach offered by Cibik and Hardos to determine 
whether they are ethically unreasonable and thus require actions. According to the authors 
conspiracy theories are ethically unreasonable when they express and amplify underlying beliefs 
that are at odds with the spirit of liberal democracy. Thus, conspiracy theories are deemed 
harmful when they undermine the liberal-democratic ideals of (1) mutual respect, (2) freedom 
and (3) equality and hence challenge reasonable pluralism. If one or more of these criteria is 
applicable to a certain theory, it is deemed ethically unreasonable (Cibik and Hardos 2020, 12). 
The first theory to be analysed is QAnon’s core theory of an evil cabal or deep state 
with Trump as the saviour. It revolves around the idea that a Satan worshipping cabal of 
paedophilic elites secretly tortures and even eats children to extract the allegedly life-extending 
chemical adrenochrome. This idea is rooted in ancient blood-libel, an anti-Semitic canard that 
falsely accuses Jews of murdering Christian children to use their blood in religious rituals 
(Dittrich et al. 2020, 21). While some argue that the term has taken on a much broader meaning 


today, it is still considered deeply offensive in the Jewish community (BBC News 2011). Any 


36 


anti-Semitic conspiracy theory is ethically unreasonable according to Cibik and Hardos’s 
framework because it undermines equality and mutual respect of citizens. Further, accusations 
of cannibalism and sexual abuse of children are clearly derogatory. 

The idea of blood-libel is not new or unique to QAnon but is a trope that has been used 
in vatious context throughout the last centuries (Harari 2020). Although some of the members 
of this evil cabal are in fact Jewish, like George Soros or Mark Zuckerberg, there are many that 
are not. Rather, they are a mix of religious and political leaders, entertainers and entrepreneurs 
whose commonalities are limited to vast amounts of money and power. What is more, they do 
not support Trump and are by default evil. It might be argued that many QAnon adherents are 
not even aware of the anti-Semitic aspect of this part of the conspiracy theory. Instead, the 
theory simply serves as a convenient explanation for everything that goes wrong in the world 
and is too grand to comprehend. Furthermore, it could be objected that not only are the 
members of the cabal indeed rich and powerful members of society, they are also public figures. 
As such, they are subject to all forms of ridicule, slander and libel which they must endure unless 
they can prove that the writer or publisher acted with “actual malice” and knowingly or 
recklessly disregarded the truth (Bugh 2009). It is safe to say that hardcore conspiracy theorists 
genuinely believe in an evil cabal and deep state. A poll conducted in the UK by Lawrence and 
Davis showed that a quarter of those interviewed either agreed or strongly agreed with QAnon’s 
central narrative of an elite child sex trafficking network'* (Lawrence and Davis 2020, 28f). 

While the cabal narrative does not undermine anyone’s freedom, it does assume not 
only a hierarchy but that certain influential individuals use their powerful position to take 
advantage of the rest of society for their personal gain, thus equality is not given anymore. The 
cabal theory makes strong accusations of cannibalism, sexual abuse and blood libel, thereby 
undermining mutual respect, and the anti-Semitic aspects, whether followers are aware of them 
ot not, may lead to violence against Jews. Thus, the core narrative is ethically unreasonable. 

Another branch of the QAnon conspiracy theory is concerned with Covid-19 
conspiracy theories which can be roughly grouped into three categories concerning (a) the origin 
of the virus, (b) its purpose or (c) how it is spread. According to (a), Covid-19 is either a 
bioweapon designed to manipulate the 2020 US presidential elections and prevent Trump’s re- 


election or a bioweapon designed by China to wage war against the US. These theories are 


'8 As previously mentioned, there is little to no scientific research on QAnon and at the time of writing there was 
no comparable data available on QAnon in Germany or the US. However, the UK is among the countries with the 
largest QAnon community around the world, thus the data is a good indicator for the effects of QAnon narratives 
on society. Table 1 is hence to be understood as just that, an indicator. The numbers might well vary in Germany 
where anti-Semitism played a significant role in the country’s past and is strongly condemned. 
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relatively broad and vague which makes analysing them difficult, particularly in regard to the 
first criterion, mutual respect. Of course, blaming China for a global pandemic is certainly not 
respectful and similar to the anti-Semitic aspect of the cabal theory, it promotes hate and 
violence toward Chinese people, particularly those living abroad. Regarding the other two 
criteria, freedom and equality, the theories do not undermine anybody’s freedom or equality. 
Based on this, the theory that the virus is a bioweapon designed to undermine the presidential 
elections cannot be deemed ethically unreasonable, while the addition that it was created by the 
Chinese is in fact ethically unreasonable as it might promote anti-Asian hate. 

According to theories in group (b), the virus is either a hoax used to meddle in the 
presidential elections or it is a tool used by Trump himself as part of his plan to overthrow the 
Deep State. The first of these two theories is again very vague with no clear perpetrator. Thus, 
it can be argued that none of the criteria are fulfilled to deem the theory ethically unreasonable 
as it is not directed at a specific person or group. On the other hand, it questions the other 
party’s commitment to mutual respect as election fraud is a serious offence. So, one could also 
argue that the mere accusation of it, even if not directed at anyone in particular, undermines 
mutual respect. The second theory assumes that the virus is a cover-up for a large-scale 
operation led by Trump who is in fact arresting hundreds of people involved in the Deep State. 
This theory is even harder to classify as there is no “bad guy” involved and violates none of the 
criteria. This second group of Covid-19 conspiracy theories is particularly difficult to judge. 

The last group contains theories that argue that Covid-19 is spread through 5G towers 
as well as some saying that Asian males are more susceptible to the virus based on 
abovementioned study by Zhao et al. (2020) and that Americans thus do not need to fear the 
virus. The claim that 5G radiation caused the pandemic is intertwined with the conspiracy theory 
that Bill Gates is planning to microchip everyone. The theory explains that 5G was used to 
spread a virus for which Bill Gates will then issue a vaccine containing microchips that he can 
use to control the people (Lawrence and Davis 2020, 9; 13; 34). There are variations of the 
theory with some accusing China for spreading Covid-19 through its 5G towers and others 
suggesting George Soros and Anthony Fauci would profit from a potential vaccine as well and 
are thus in cahoots with Bill Gates. Applying Cibik and Hardos’s criteria of (1) mutual respect, 
(2) freedom and (3) equality, this strain of conspiracy theories is xenophobic as it incriminates 
China and Chinese people. It could further be argued that it is also anti-Semitic for accusing 
George Soros of playing a part in creating a global pandemic. Thus, the theory undermines two 


of the three criteria, mutual respect and equality, and therefore is ethically unreasonable. The 
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idea that Asian males are more susceptible does not put any blame on Asian men but assumes 
superiority of other races. It therefore subverts equality and is ethically unreasonable. 

Another conspiracy theory that originated in the QAnon community in June 2020 
revolves around the American retail company Wayfair. Proponents of the theory had noticed 
that the retailer’s pieces of furniture had female names and were sold at high prices, thus they 
concluded that the company was involved in child sex trafficking. QAnon followers then began 
linking the names of particularly expensive pieces of furniture to actual cases of missing children 
with the same name (Spring 2020; Marc-André Argentino 2020c). 

The target of this narrative is an online retailer rather than a person or group of people. 
It revolves around the child sex trafficking theme and as Argentino outlines, proponents of the 
theory incriminate celebrities of being involved in this conspiracy (Argentino 2020). The theory 
remains rather vague, broadly accusing Wayfair and roughly the same people as those involved 
in the cabal theory of using the internet retailer for trafficking children. As such it is part of the 
central narrative of QAnon which has already been deemed ethically unreasonable. 

The last branch of QAnon conspiracy theories to be analysed is concerned with election 
fraud in the 2020 US presidential election. Even before the election, QAnon adherents 
suspected the cabal and democrats of having designed the pandemic to prevent Trump’s re- 
election. The announcement that Joe Biden was elected to become the next president of the US 
confirmed their beliefs and fuelled conspiracy theorising further. While it swayed some 
followers, many stayed and reassured each other to “trust the plan”. As a result, the narrative 
shifted to account for the failed prediction. Again, this part of the conspiracy theory is quite 
broad and vague, accusing anyone who is not a Trump supporter of being in cahoots with the 
cabal, the in-group versus out-group mindset that is characteristic of conspiracy theories, which 
makes it more difficult to apply the three criteria for ethical reasonableness. The theory does 
not directly target a person or specific group, nor does it undermine anybody’s freedom or 
mutual respect. Yet, it could be argued that it presupposes some form of inequality to explain 
why Biden won despite all of the QAnon adherents’ efforts. 

To summarize, the selected branches of the QAnon conspiracy theory all contain some 
parts that can be argued to be ethically unreasonable because they target certain individuals or 
groups based on religion or race or undermine liberal democracy by assuming some level of 
inequality. Ultimately, QAnon blames the deep state and/or evil cabal for everything that is 
going wrong or against their beliefs. The centre of the cabal is made up of people who are 
generally wealthy, powerful and disagree with Trump’s politics. The conspiracy theory has a 


tendency to latch onto and merge with other movements, i.e. Save the Children or far-right 
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movements. By so doing, the movement was able to grow rapidly on social media as users who 
search for certain hashtags often ended up finding QAnon and got sucked into the conspiracy 
theory without noticing. The German QAnon movement is largely decoupled from the original 
theory and has adapted to its local context by merging with German far-right groups and 


movements like Querdenken 711. 


5 Discussion 


Social Media and Freedom of Speech 
The internet potentially give its users access to real freedom of expression and companies have 
repeatedly pledged their commitment to freedom of speech. However, the vast amount of 
information and data needs to be managed and regulated somehow to be of use. Currently, big 
tech firms are in charge of controlling this flow of information. They are relying more and more 
on AI and algorithms to not only structure the data but to tailor it towards the individual user."” 
In its broadest sense, freedom of speech includes the right to seek out and search for 
information freely. Tech giants continuously infringe on that right by controlling the flow of 
information available on their platforms, restricting access to information and determining the 
rules of public conversation. What is more, they do this based on commercial interests”, and to 
keep their users they are eager to maintain an agreeable environment in which people feel 
comfortable and safe. As a result, the community standards of social media platforms are often 
tougher and mote restrictive than actual legislation when it comes to freedom of speech. 
Furthermore, these companies usually have internal staff guidelines regarding content 
moderation which are not publicly accessible (Stjernfelt and Lauritzen 2020, 90). Thus, content 
removal is not a transparent process and can seem arbitrary at times meaning that users have 
little chance of understanding why their content or account has been banned. 

At the same time, the platforms rely on users to report and flag content that violates 
their terms of service or community standards (Stjernfelt and Lauritzen 2020, 120). Each week, 
they have to sort through millions of complaints, a number too high to process without the help 


of AI. The censoring standards applied by AI are not adapted to cultural, geographical or 


19 This creates so called filter bubbles. If two users search for the same key words on google, for instance, both 
users will see different results since the results are based off of all the information that has been collected about 
them. Twitter allows its users to actively decide how their feed is filtered and even offers them to opt out of 
personalization. But other platforms, like Facebook, do not provide this option Stjernfelt and Lauritzen 2020, 
35ff). For this reason, filter bubbles are seen by many as the causes for misinformation. However, it should be 
pointed out that this is not a new phenomenon but was already a problem in the Republic of Letters. 

20 The commodity being attention, hence the name attention economy. The overwhelming amount of information 
that is available online has caused a deficit of attention, turning it into a scarce resource. Hence, big tech companies 
are competing over attention (SStjernfelt and Lauritzen 2020, 200; Johnson 2018, 1275). 
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jurisdictional differences, but reflect the worldview of a small group of people: the usually 
wealthy white men working as software engineers for big tech firms. Although AI is not very 
sensitive, it is set to work without any human involvement resulting in over-censorship. Genuine 
discussions about certain topics for instance are censored along with actually harmful content 
because AI cannot distinguish between the two. Thus, meaningful conversations are blocked 
which is clearly a violation of free speech. There is still a lot of content that is reviewed by 
human staff; however, the companies’ broad censorship policies rely on the subjective 
judgement of staff with often insufficient training (Stjernfelt and Lauritzen 2020, 134). While 
some cases are clear, others are in a grey area and require careful consideration of the context 
in which certain statements are being made. After all, truth is relative. In an effort to tackle rising 
concerns about censorship, Facebook introduced an Oversight Board in October 2020 to 
decide which content should be taken down and to “give users an independent third party to 
whom they can appeal Facebook moderation decisions, as well as to help set the policies that 
govern these decisions.” (Terjesen 2021; Oversight Board n.d.).”" Considering the high amount 
of content that is being reviewed on a daily basis, the Oversight Board will only be able to handle 
a few selected high-priority cases such as the suspension of Donald Trump’s account. Thus, it 
is not a solution to content moderation and the introduction of an ethical framework might 


bear more fruitful results. 


The suitability and applicability of an ethical framework for categorising conspiracy 
theories online 

The case study above tested an ethical framework to be applied specifically when examining 
conspiracy theories on social media. One deciding criteria is that of inequality which indicates 
ethical unreasonableness. According to Cibik and Hardo§, “reasonable doctrines, opinions and 
worldviews do not aim to impose their perspective on other citizens by using state power. They 
recognize the right of the citizens to make up their own minds [...] and refuse to denigrate each 
other even if some [...] hold views that others consider wrong or even silly.” (Cibik and Hardo$ 
2020, 11). The core element of conspiracy theories, however, is that a group of people conspires 
against others. There is no conspiratorial scenario in which all members of society are equal 
because there must always be a hierarchy between those allegedly conspiring and the rest, an in- 
group and an out-group. Political conspiracy theories like QAnon are usually concerned with 
convincing others that there is something dishonest going on behind the scenes and uncovering 


the conspiracy. In QAnon’s case, there is a global cabal of elites who secretly run the world and 


21 Considering that the board is funded with $130 million by Facebook, its independence may be questioned. 
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traffic children. They distinguish between those who are woken up already and those who are 
under the influence of the cabal — again running counter to the idea that all citizens are free and 
equal. This shows that freedom and equality are not necessarily helpful criteria since the very 
definition of a conspiracy theory runs counter to them and they can thus not be accurately 
applied. It might be a matter of producing a more precise definition of what it to be understood 
as equal or simply replacing it with another, more suitable criterion. Interestingly, the authors 
consider freedom and equality to be the most important of all criteria. 

QAnon is an extremely convoluted conspiracy theory that keeps growing and adding 
mote theories to its narrative. Most of these theories are somehow linked to the core narrative 
of the evil cabal which is the ultimate scapegoat for anything that is wrong in the world. By so 
doing, QAnon has merged with other movements making it difficult to keep them apart and 
analyse them separately. This is less a problem with Cibik and Hardos’s framework but with the 
nature of conspiracy theories and QAnon specifically. Nonetheless, QAnon’s central narrative 
is clear and has been shown to be ethically unreasonable for its anti-Semitic undertones. 

Yet, it could be argued that QAnon’s core narrative is so extreme and “out there” that 
it falls under what Martha Nussbaum refers to as silly beliefs (Nussbaum 2011, 29). What is 
more, the alleged cabal consists of a group of people from a variety of religious and ethnic 
backgrounds. The fact that George Soros, who is known to be Jewish, is included has more to 
do with his wealth and powerful position in society rather than his denomination. Indeed, the 
official German QAnon website Qlobal change explains that Soros is sponsoring Antifa with 
the goal of bringing back nationalism (Qlobal-Change n.d.). Nationalism is inherently anti- 
Semitic and it would be paradoxical for him to sponsor its comeback. That being said, it is 
without question that QAnon propagates ancient anti-Semitic notions thereby fuelling anti- 
Semitic sentiments. The previously mentioned poll conducted by Lawrence and Davis found 
that 17% of those interviewed agreed or strongly agreed with the statement “Jews have 
disproportionate control of powerful institutions, and use that power for their own benefit and 
against the good of the general population”, see figure 1 (Lawrence and Davis 2020, 28f). 
Support for this statement varies among different age groups but as can be seen in figure 1, this 
belief is a lot more prevalent among younger age groups, with support among those aged 25 to 


34 rising to 30% (Lawrence and Davis 2020, 29)”. 


22 There might be many reasons for that, however, it could be that younger people spend more time online and are 
thus more easily influenced by internet propaganda and conspiracy theories simply because they may be exposed 
to it more. 
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To what extent to you agree: “Jews have disproportionate control of powerful 
institutions, and use that power for their own benefit and against the good of the 
general population” 


Agree 


Strongly agree 


0% 2% 4% 6% 8% 10% 12% 14% 16% 18% 20% 


@ Total @ 18-24 @ 25-34 @ 35-44 @ 45-54 @ 55-64 @ 65-74 mw 75+ 


Figure 2: Support for one of Q's central narratives among various age groups in the UK (Lawrence and Davis 2020, 19) 


Another study found that the conversations in online QAnon groups pivot around 
hatred towards Jews and other groups of specific races or religions (Papasavva et al. 2020, 11). 
So, while some QAnon adherents might be oblivious to or ignorant of the anti-Semitic tropes 
promulgated, an alarmingly high percentage of followers clearly harbour anti-Semitic 
sentiments. Containment of this particular part of the theory is therefore appropriate. 

So far, it has been shown that an ethical framework such as the one proposed by Cibik 
and Hardo$, albeit in need of some adjustments, can be useful in determining which conspiracy 
theories requite some form of action. Another question is that of the applicability of the 
framework and its suitability to categorise conspiracy theories. Facebook and Twitter need to 
sift through thousands of complaints on a daily basis. A big bulk is handled by AI, but a lot is 
still left for human staff to examine. Stjernfelt and Lauritzen estimate that each person reviewing 
flagged posts has about two seconds per post to decide whether it should be removed or not, 
leading to over-removal in a better-safe-than-sorry-attitude (Stjernfelt and Lauritzen 2020, 134). 
This is obviously not enough time to make a good decision generally, let alone about 
controversial content. The ethical framework as suggested by Cibik and Hardos is insufficient 
and needs to be refined and extended by additional criteria. Applying the framework requires 
for each post or theory to be examined by going through the list of criteria to determine the 
ethical reasonableness which takes longer than two seconds. It is therefore not a method that 
can be used on a daily basis by human staffers tasked with content moderation. Instead, it could 
be used for training purposes for instance. As Stjernfelt and Lauritzen point out, staff working 


for Facebook and Twitter are ill-equipped to execute content moderation adequately because 
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they have simply not been trained (Stjernfelt and Lauritzen 2020, 200). While there will always 
be a certain degree of subjectivity, the companies should strive to reduce that to a minimum as 
content moderation should be guided primarily by ethical and legal standards. Laws are facts 
and the distinction between legal and illegal is relatively clear-cut. Ethical decision making, on 
the other hand, is a skill that needs to be acquired and practiced. Thus, the tested framework 
could be used to sensitise staff to content where law cannot be applied easily, ie. conspiracy 
theories, and to train them to make more ethical decisions that protect the user’s right to 
freedom of speech. Another area of application could be for policy advisors, particularly those 
working for tech companies. They could apply the framework to suspicious content and decide 
what needs to be banned before giving clear instructions to content moderators. If the ethical 
framework is made part of the companies’ terms of service, users know how decisions are being 
made. Ethical values while tinted by cultural values are more universal and decisions based on 
ethics may thus be more acceptable globally. 

Cibik and Hardos argue that if a theory is found to be ethically unreasonable, its 
containment is justified (Cibik and Hardos 2020, 12). Yet, I would argue that ethical 
unreasonableness alone is not enough to justify deplatforming thousands of users from major 
social media platforms. The analysis has shown that the core narrative of QAnon is ethically 
unreasonable because of its anti-Semitic aspects. Since QAnon is a superconspiracy, everything 
is connected, and the evil cabal is responsible for all the perceived evil in the world. 
Subsequently, any theory or movement linked to QAnon must be deemed ethically 
unreasonable if it is linked to the evil cabal. This then results in the banning and removal of 
thousands of users from Facebook and Twitter all around the world, often constituting a 
violation of free speech, te. in the US. Further, deplatforming on such a large scale may have 
consequences for society and should only be considered in severe cases. Thus, the ethical 
framework should be extended by an additional consideration: how real is the threat to political 
stability that is the liberal democratic order in actuality? Quong argues that unreasonable citizens 
who partake in the wider (liberal) society pose more of a threat to political stability than those 
who keep to themselves and do not interact much with the rest of society (Quong 2004, 328f). 
However, even then the context needs to be considered: how large is the number of people in 
question, has that number grown significantly over a short period of time and which society or 
societies are affected? Additionally, known triggers for conspiracy theorizing also need to be 
assessed before making a decision. Events like political unrest, natural disasters or a global 
pandemic, for example, can leave people feeling out of control, anxious and with low levels of 


trust, fueling conspiracy thinking. In QAnon’s case, the number of followers has grown 
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exponentially over the course of a year and the theory has spread far beyond its country of 
origin. This increase in followers correlates with the spread of the Covid-19 pandemic (Labbe 
et al. 2020; Lawrence and Davis 2020, 9; McQuillan et al. 2020, 5). Hence, all of the factors that 
may increase the threat to political stability apply, justifying the containment of QAnon. 

It should be highlighted that the proposed framework is in no way airtight as some 
theories which pass the test might still be harmful, a fact that is acknowledged by Cibik and 
Hardos as well (Cibik and Hardos 2020, 13). Likewise, not all ethically unreasonable theories 
justify an outright ban and it should be assessed first if they threaten the liberal democratic order 
(Quong 2004, 328). 


Is banning QAnon from Facebook and Twitter a violation of free speech? 

Even though there are good reasons to contain the spread of QAnon, I am inclined to argue 
that the outright ban of the theory including its followers still constitutes a violation of free 
speech. It has already been established that judging the companies’ actions concerning QAnon 
based on free speech alone is not a constructive approach. Nonetheless, freedom of speech is a 
major concern when it comes to online content moderation measures such as deplatforming. 
Of course, there is no simple, straight-forward answer if one is to take local context, legislation 
and ethics into account. Facebook and Twitter cite concerns over offline harm as their main 
reason for banning QAnon assets. In the analysed period from February 2020 to February 2021 
alone, there have been various instances of offline harm, especially in the US. The origin of 
QAnon, the Pizzagate conspiracy theory, already inspired people to arm themselves and storm 
the DC pizza parlour Comet Ping Pong. Thus, the very origin of the theory can be considered 
violence inducing. In 2019, a year before Facebook and Twitter began taking down QAnon 
assets, the FBI issued its first warning of the QAnon conspiracy theory and its potential to 
inspire violent acts. Why did Facebook and Twitter decide to act against QAnon only in mid- 
2020 and not earlier? It seems a bit arbitrary and odd that the companies waited so long to react 
and citing the potential for offline harm is an easy pretext because it does indeed justify the 
suspension of accounts as outlined in their community standards. Furthermore, there have been 
far fewer incidences in Germany and it has not even been proven yet that the vandalism at 
Museumsinsel in Berlin is connected to QAnon. Based on that, a complete ban of QAnon is 
not justified. Instead, it could be argued that QAnon promotes anti-Semitic sentiments which 
is a particularly sensitive topic in Germany and would justify a ban there as well. That, however, 


is not the rationale of the social media companies. 
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Another aspect supporting my argument that permanently banning QAnon violated free 
speech is that in the instances named by the companies, it was Trump who incited violence as 
he deliberately used the conspiracy theory for his political gain. Thus, the most problematic part 
of QAnon is not that its core narrative is anti-Semitic but that the person considered to be either 
Q himself or the saviour installed by Q, is directly and indirectly re-enforcing the conspiracy 
theory. Trump realised early on which potential conspiracy theories had for his political career 
and utilised them for his political agenda. He successfully won over voters that usually do not 
partake in mainstream politics and are prone to conspiracy thinking. This was mainly thanks to 
his deft use of social media, especially Twitter, where he had an enormous reach. While Trump 
did not follow any QAnon-related accounts, some of his follows did, which is how their content 
appeared in his Twitter feed and was eventually retweeted by Trump. This led QAnon followers 
to conclude that the president secretly approved of them and their theories and confirmed their 
assumption that he was one of them. Thus, they continued to support him (McIntire, Yourish, 
and Buchanan 2019). An integral part of Trump’s election campaign, social media remained his 
main tool for communicating with the public until the suspension of his accounts in January 
2021. This was complemented by the support of various fringe and alt-right media outlets such 
as Breitbart and Fox News which were key to his success since the conspiracy community 
nowadays gets their news from alternative media outlets, as they mistrust the mainstream and 
traditional media. Qlobal-change, for instance, dedicates an entire page to alternative news 
outlets that are allegedly trustworthy. Trump managed to push fringe websites and their 
conspiracy theories into the mainstream, so much so that conspiracy theories have been 
somewhat normalised (van Prootjen 2019). He also repeatedly declared other news outlets as 
“fake news’, further fuelling distrust in traditional media among conspiracy theorists and 
confirming Q’s claims that they cannot be trusted (Mayer 2019). Further, Trump pushed various 
theories central to QAnon first and foremost theories surrounding the 2020 US presidential 
election and Covid-19. Early on he spoke of rigged elections and that any outcome other than 
his re-election would be proof of election fraud. Even after he lost, he held on to these claims 
and demanded for all votes to be (re)counted. Similarly, he downplayed the Covid-19 pandemic, 
questioned the benefit of face masks, thereby undermining global efforts to curb the spread of 
the virus. When asked point-blank what he thought of QAnon, Trump failed to denounce the 
conspiracy theory and instead called its adherents “people that love our country”. Confronted 
with the question of whether he supported the theory he simply replied he was willing to “help 
save the world from problems” and ‘put himself out there’ (Rogers and Roose 2020). Of course, 


QAnon followers are practiced in interpreting the former president’s every move or comment 
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as validation of Q’s prophecies. The insurrection at the White House on January 6, 2021, is not 
that surprising if one considers Trump’s preceding statement at the rally that day, calling on the 
attendees to “fight like hell” as otherwise “you’re not going to have a country anymore” 
(Tollefson 2021). Eerily similar to Mill’s corn dealer analogy, this was the last straw in a series 
of quasi endorsements of QAnon by Trump. Paired with QAnon’s inherently game-like quality 
the subsequent violent revolt was almost inevitable. QAnon allows everyone to get involved by 
deciphering Q’s clues and find hidden meanings in them and it also offers simple solutions to 
complex problems. I.e. 5G towers are spreading Covid-19, if you destroy them, you stop the 
spread of the virus and end the pandemic. People are driven by fear and/or a desire for change 
and QAnon shows ways to make this change happen, even if the methods are radical. 
Considering the size and role of Facebook and Twitter, deplatforming excludes people from a 
significant part of public conversation simply because the companies have not figured out a 
better way to moderate their platforms. The Covid-19 pandemic accelerated the spread of 
conspiracy theories as it exacerbated fears and posed an existential threat unlike any other. This, 
however, was a predictable side-effect of the pandemic. What is more, the FBI had issued a 
serious warning about QAnon which had been ignored by social media companies until it was 
too late. In a very heavy-handed reaction, they banned thousands of users around the world, 
excluding them from a central part of public conversation for arbitrary reasons. While the 
sudden threat of the pandemic required ad-hoc measures, permanently deplatforming 
thousands of users is an inappropriate reaction. 

As with questions about human rights, sometimes a balance needs to be found and one 
right may outweigh another. The same is true for deplatforming conspiracy theories and before 
doing so, it needs to be determined what will yield the greater good: deplatforming and silencing 
a large number of people for the sake of the liberal democratic order or protecting the 
fundamental right to free speech. Deplatforming is still disputed among scholars and policy 
makers for various reasons. Without going too much into detail, I suggest that the following 
aspects be considered to determine which outcome is more desirable. 

1. Deplatforming confirms beliefs of conspiracy theorists that the mainstream media, 
which includes big tech like Facebook and Twitter, are tools used by the cabal to manipulate 
the masses. Particularly, if it happens in a concerted action and targets an entire group of people 
who already feel alienated from society. 

2. Deplatforming the entire QAnon movement was a rather heavy-handed action. The 
companies simply suspended everyone and everything based on the usage of certain hashtags 


ot keywords. This has led to calls within the QAnon community to camouflage and be subtler 
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resulting in the hijacking of hashtags of other movements, i.e. #savethechildren, thereby 
undermining their genuine efforts. Further, users got creative and deliberately misspelled certain 
words — a simple and well-known workaround to trick AI. Hence, relevant users that is those 
engaged enough to think of workarounds may not have been deplatformed while others who 
might not have even posed any threat were permanently banned from Facebook and Twitter, 
potentially for simply having liked or shared a post unknowingly, infringing on their right to 
freedom of expression. 

3. There are consequences of deplatforming, both negative and positive: on the one 
hand, it disrupts and scatters movements. On the other hand, it destroys evidence and users 
move to other platforms where it is harder to surveil them. While not all users will make the 
effort to move to new platforms and will simply lose interest, some will make the move. This 
latter segment of followers is certainly of the more fervent and invested kind willing to take 
action and actively participate. Hence, deplatforming on that scale only concentrates the 
movement on other, more private platforms. 

4. Deplatforming equals silencing. Of course, Facebook and Twitter are not obliged to 
offer their services to everybody, especially not to those who refuse to adhere by their rules, or 
publish all content produced by their users (Johnson 2018, 1275). So, in theory, users can simply 
move theit conversation elsewhere. Considering the size of the two analysed social media 
platforms, Facebook in particular with 2.85 billion monthly active users (Facebook Reports 
First Quarter 2021 Results’ 2021), being excluded from even just one of them means being 
excluded from a central part of public conversation as Facebook and Twitter resemble a virtual 
public space. Although it is still to be determined what role social media hold in society, the big 
platforms are strikingly similar to how Jurgen Habermas conceptualizes the public sphere: a 
social space in which private citizens can engage in inclusive critical discussions relevant to 
society and public interest without state interference or economic pressures (Habermas 1968). 
This public sphere can be a physical place such as a coffee house or an abstract or metaphorical 
one like the media which, in theory, can facilitate and foster ongoing discourses and political 
debates. The internet has taken this to the next level by providing a virtual space that can be 
accessed by anyone from anywhere in the world, offering seemingly endless possibilities for 
debate, thus constituting a global public sphere. When Habermas described the public sphere 
in the 1960s, he already warned of a refeudalization: the rise of a few increasingly powerful 
organisations that influence and shape the public sphere (Habermas 1968, 157). The same has 
happened with the internet today. A few tech firms have come to dominate the internet, among 


them big social media companies like Facebook and Twitter with billions of users around the 
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world. They heavily regulate this virtual public sphere, determining what can and cannot be said 
based on rules that are loosely based on law and human rights guidelines. Considering the size 
and global spread of some big tech firms, looking to philosophy and concepts such as that of 
the public sphere might help determine their role and responsibilities in society and make it 
easier to hold them liable. 

For these reasons, deplatforming should only be used as a last resort. While conspiracy 
theories can of course have unwarranted effects on society, not all do and simply containing all 
of them runs counter to the key liberal ideals of pluralism and free speech. After all, far-fetched 
theories and claims are not limited to conspiracy theorists only. Astrology and religion for 
instance make claims that can easily be rebutted and the latter particularly has caused much 
harm throughout centuries yet a ban on either of them is out of question”. Hence, it should be 
considered to ban users temporarily instead of permanently. Further, such decisions should be 
reassessed regularly to account for changes, i.e. in the political climate, and if applicable reverse 


the decision. 


The way forward 

Social media companies walk a fine line between adequate content moderation and respecting 
fundamental human rights. One societal objective cannot be achieved at the expense of another, 
thus striking that balance, albeit a tricky challenge, is key. To achieve this objective big tech, 
courts and governments need to pull together. Big social media platforms need to be defined as 
to their role in society and subsequently their tasks and responsibilities. Only then can 
governments and courts issue policies and laws that can hold them accountable, ideally on a 
supranational level although this could prove difficult to realise given the differences in free 
speech legislation alone. Social media companies in turn need to step up and cooperate more 
with local governments and courts by providing access to data and issuing clear, overt and 
publicly available policies. The analysis revealed that Twitter’s community guidelines and 
policies tend to be clearer than Facebook’s, not only in their wording but also in their 


accessibility. The company clearly explains what is allowed on the platform and what is not as 


23 An extreme example is the Church of the Flying Spaghetti Monster, or Pastafarianism, which began as a parody 
teligion but quickly turned into a social movement, arguing that anything can be a religion as “[t]here are several 
levels of Belief [sic] and each is no more or less legitimate than the other.” (About Church of the Flying Spaghetti 
Monster’ 2021). Not only has the movement gained several thousand followers within just a few years, it has also, 
often successfully, challenged laws giving privileges to religious ideas and practices. In the Netherlands, for instance, 
the Church of the Flying Spaghetti Monster was accepted as a religion in 2016 (Bauer 2018). By labelling 
Pastafarianism as a religion, the movement managed to claim rights and recognition, highlighting the arbitrariness 
of the modern definition of religion. It could be argued that the basis of Pastafarianism is perceived as harmless, 
thus making it easier for them to be awarded recognition. 
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well as the consequences of any violation to these outlined rules. The rules can be found easily 
and are structured in a comprehensible manner. By contrast, Facebook’s community standards 
are convoluted, vague and do not provide clear insights into their content moderation measures 
— although their update in June 2021 briefly explains how they police violations (Facebook 
Transparency 2021c). What is more, Facebook’s rules, policy explanations and updates are 
scattered over various websites and can be difficult to find. On top of that, the company has a 
set of internal policies that are not publicly accessible even though they affect users globally. 
Twitter is generally more forthcoming and reacts faster to arising threats. But here lies another 
issue: both social media companies, Facebook in particular, always only re-act instead of acting 
and make rules on the fly resulting in flawed and inadequate measures such as deplatforming an 
entire movement of thousands of people around the world. 

When it comes to moderating content on social media, in particular conspiracy theories 
and movements, applying an ethical framework is useful but only in conjunction with careful 
consideration of the context and a true understanding of the particular conspiracy theory as well 
as conspiracy theories generally. Knowing which events trigger conspiracy theorising, for 
instance, can help prevent them from getting out of hand in the first place. Facebook is working 
with external fact-checkers™ while Twitter is working on implementing its own fact-checking 
programme to combat misinformation. Additionally, the companies could consider 
collaborating with extremism experts and those with in-depth knowledge about conspiracy 
theories. By so doing, the companies can react faster to emerging threats and tailor their actions 
to the specific situation and local context. Elections, for instance, which can heighten conspiracy 
theorising, take place at different times around the world. Hence, actions might not have to be 
implemented globally but only in the affected areas at these specific times. Further, instead of 
deplatforming an entire movement, conspiracy theory experts would be able to conduct targeted 
action by identifying key figures within the movements. A study by Papasavva and colleagues 
found that some users within the QAnon community are a lot more active than the majority, 
with one user accounting for up to 30% of all analysed posts” (Papasavva et al. 2020, 11). So 
instead of blindly banning everyone, targeted and informed actions will yield better results 
without risking human rights violations. The same study also found that many users migrated 


to new platforms after having been banned from Facebook and Twitter. Thus, if it were 


24 Facebook’s fact-checking process is still largely obscure and it has been suspected that the company avoids 
sending certain news through the fact-checking system to avoid their labelling since fake news generate a lot of 
attention and therefore profit (Stjernfelt and Lauritzen 2020, 120f). 

25 A finding that is replicated in a similar study about vaccine disinformation online, showing that just twelve users 
are responsible for 65% of the shares of vaccine misinformation on social media (Bond 2021). 
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necessary to deplatform a larger number of people, doing so in increments rather than all at 
once might prevent coordinated migration to other platforms. Lastly, social media companies 
need to cooperate, ic. by changing their algorithms and feed recommendations. This is 
connected to them being redefined as their current algorithms serve theit economic interests 


rather than societal interests. 
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Part III: Conclusion 


The starting point of this paper was the question of whether banning QAnon from Facebook 
and Twitter was a violation of free speech or whether it was justified. After examining free 
speech in the US and in Germany, it became clear that analysing the deplatforming of QAnon 
through free speech legislation is not a useful approach. Social media companies are not legally 
obliged to offer their services to each and every person as they are currently considered private 
businesses and as such get to make their own rules. Thus, any commitment they make to 
freedom of speech is only voluntary. In the US, they are even explicitly exempt from being held 
liable for third-party content that is posted on their platforms under Section 230 of the 
Communications Decency Act. But even if they were legally bound by free speech legislation, 
it would be almost impossible to respect the various limitations of free speech around the world 


on such globally accessible social media platforms” 


. So, the platforms must either be geared to 
the strictest free speech legislation, meaning restricting what can be said even further. Or they 
need to lift their current limitations on free speech and strive for the widest possible definition 
of it. I believe the latter is the more realistic and fruitful approach. Both Facebook and Twitter 
pledged to protect freedom of speech with Twitter stating that their “mission is to give everyone 
the power to create and share ideas and information, and to express their opinions and beliefs 
without barriers. Free expression is a human right — we believe that everyone has a voice, and 
the right to use it. Our role is to serve the public conversation, which requires representation of 
a diverse range of perspectives” (Twitter Inc. 2021f). This must mean allowing all views and 
opinions including more extreme ones or those running counter to popular beliefs. Rather than 
imposing more restrictions on users, the companies should invert their rules for public figures 
for whom they apply different regulations. It makes no sense to allow celebrities, politicians and 
the like who have a much bigger audience and wider reach to say whatever pleases them. Not 
only are they followed by often millions of people around the world, people tend to look up to 
these public figures and more readily believe what they say. The analysis has proven this point, 
identifying Trump’s quasi endorsement as the driving force that kept the QAnon community 
going and ultimately led to the insurrection at the US Capitol in 2021. Hence, I suggest 
monitoring official accounts more closely and restricting what they can say and do on platforms 
like Facebook and Twitter. That being said, social media companies should not be deciding over 


matters of free speech. This is a question of redefining their role and responsibilities. As 


26 Creating a supranational law for globally operating social media companies might be a solution, albeit a utopian 
one as it would mean that all countries in which the respective companies operate would have to agree on one 
single definition. This is unlikely to happen any time soon since legislation is usually born out of a country’s history, 
culture and values which differ vastly around the world. 
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businesses they act in their own economic interests and unfortunately, fake news, 
misinformation and conspiracy theories are incredibly profitable as they generate attention — 
the only commodity that matters on social media. The reluctance of both Facebook and Twitter 
to ban or restrict Trump and QAnon despite early warnings from the FBI and the scientific 
community could be seen as an economic decision since both generated a lot of attention 
around the world. 

Content moderation should aim to protect freedom of speech however, the different 
understandings and realities of this particular human right render it inadequate to guide content 
moderation. Thus, I brought in an ethical framework to help determine whether QAnon’s ban 
was justified. Indeed, the analysis showed that the conspiracy theory’s core narrative is ethically 
unreasonable, thus generally justifying its ban, at least in times of crises. Further, it has been 
assessed that conspiracy theories require in-depth knowledge and context, hence social media 
companies are advised to collaborate with extremism experts who specialise in conspiracy 
theories as they can, for instance, identify key figures within such movements, allowing more 
nuanced and targeted content moderation measures. The use of an ethical framework can be 
helpful to make more meaningful and well-founded decisions that are less likely to infringe on 
people’s freedom of speech for no apparent reason. Since the application of the framework with 
all its steps is too time-consuming for everyday content moderation, it could instead be used to 
train staff in acquiring ethical decision-making skills. This would be beneficial beyond the 
analysis of conspiracy theories. 

Unfortunately, I was unable to analyse original QAnon posts on Facebook and Twitter 
as the platforms have taken down all QAnon related content and made it impossible to search 
for it. Instead, I had to rely on data that had been collected by other researchers as well as other 
secondary soutces like newspaper articles. I was also able to examine original Q drops and the 
official German QAnon website Qlobal-change. However, it would have been even better to 
compate what was originally propagated to how it played out in the QAnon communities on 
Facebook and Twitter. This leads me to reiterate my point that social media companies need to 
collaborate with researchers, governments and courts by providing access to data. 

Discussions around freedom of speech, hate speech and their respective boundaries 
must continue at all times and in public. Social media companies have incredibly powerful 
positions as they can adapt and restrict access to data. Businesses and corporations will always 
be profit-oriented and thus should not be entrusted with defining and deciding over 
fundamental human rights and their boundaries. They may merely execute whatever consensus 


has been reached. The redefinition of social media companies is indispensable. Future research 
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should therefore focus on defining the role and responsibilities of social media companies more 
clearly. This will not only help draft more precise legislation, it also will also mean that 
companies and legislators can react faster in times of crisis as allocation of tasks is clear. For 
now, social media companies are still in charge of content moderation. Thus, it is essential that 
they cooperate with external partners as well as provide better training for their staff, including 
not just content moderators but also software engineers who are in charge of training AI to 
support content moderation efforts and policy advisors working for Facebook and Twitter. 


Hence, the ethical framework should be expanded and adjusted accordingly. 
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Figure 1: Twitter announces actions against QAnon assets across the platform (Iwitter Safety 
2020) ie) 
Figure 2: Support for one of Q's central narratives among various age groups in the UK 
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